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This  research  and  development  was  conducted  In  support  of  Exploratory  i 

Development  Task  Area  ZF522.011  (The  Assessment  and  Enhancement  of  Pre-  I 

requisite  Skills). 

The  overall  project  covered  comprised  two  phases.  The  first  phase,  which  i 

provided  information  on  the  role  of  reading  skills  within  the  context  of  j 

the  Navy's  occupational  and  career  development  systems,  was  documented  by 
IW’RDC  TR  77-40,  The  Role  of  Reading  in  the  Navy  (Sticht,  Fox,  Hauke,  & Zapf, 

1977).  The  second  phase,  which  is  documented  by  this  report,  provides  a 
general  approach  to  the  design,  development,  and  implementation  of  a training 
system  that  incorporates  both  job  skills  and  learnlng/communlcation  skills 
Improvement  within  an  Integrated  framework. 

The  results  of  this  study  are  Intended  for  use  by  the  Chief  of  Naval 
Education  and  Training.  Dr.  Thomas  Duffy  acted  as  contract  monitor. 


J.  J.  CLARKIN 
Commanding  Officer 
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SUMMARY 
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Problem 


In  the  past,  training  research  and  development  efforts  have  been  directed 
at  adapting  the  training  system  to  individual  differences  in  cognitive 
and  affective  processes.  Recently,  R&D  efforts  have  been  initiated  for 
providing  training  to  help  the  learner  become  a more  adaptive  person  by 
improving  his  basic  learning  communication  skills  within  the  context  of  an 
adaptive  training  program.  One  such  skill  is  reading;  that  is,  using 
written  language  in  performing  job  tasks.  Although  reading  and  writing 
skills  are  widely  used  in  Navy  school  and  job  settings,  approximately  20 
percent  of  the  Navy's  enlisted  personnel  have  reading  problems  that  can 
hinder  fleet  readiness  and  career  development.  Although  such  personnel 
seem  favorably  disposed  toward  training  that  Improves  job  skills,  they 
apparently  do  not  make  full  use  of  the  existing  Navy  education  system,  at 
least  in  part  because  they  do  not  consider  it  relevant  to  either  their  job 
duties  or  their  career  development. 

Purpose 

The  purpose  of  the  present  effort  is  to  design  a general  plan  for  the 
development  of  an  integrated  job  skills/reading  skills  training  system. 

Approach 

Reading  demands  of  Navy  ratings  were  determined  by  (1)  identifying 
job  reading  tasks,  (2)  classifying  these  tasks  in  some  general  taxonomy, 

C3)  constructing  a Navy  Reading  Task  Inventory  (NRTI)  and  Navy  Reading 
Task  Test  (NRTT) , (4)  scaling  the  reading  difficulty  level  of  Navy  reading 
tasks,  and  (5)  weighting  the  occurrence  of  different  tasks  in  different 
jobs  by  frequency  and  criticality  of  performance. 

The  next  step  was  to  review  the  components  of  the  Navy's  training  system 
to  identify  any  existing  formal  or  Informal  linkages  between  them  that 
might  be  used  to  facilitate  the  integration  of  job  skills  and  literacy 
skills  training.  Based  on  the  results  of  these  two  efforts,  a general  plan 
was  designed  outlining  the  initial  development  of  a job-related  reading  - 
training  program  and  its  later  integration  into  the  Navy's  job  skills 
training  program. 


Results 

Results  from  administering  the  NRTT  to  a Navy  sample  indicated  that  the 
sample  had  a median  reading  grade  level  of  10th  grade,  which  is  consistent 
with  previous  findings.  In  addition,  the  N’”T  data  showed  that  22  percent 
of  the  sample  liad  a reading  grade  level  (RGI.)  below  the  8th  grade  level. 
Thus,  It  appears  that  a fair  number  of  Navy  personnel  do  have  reading 
problems. 


Survey  of  the  components  of  the  Ndvy's  training  system  Indicated  that 
there  is  a relatively  close  interaction,  of  a formal  nature,  between  the 
job  skills  training  system  and  the  career  counseling  system,  but  little  or 
no  formal  Interaction  between  these  systems  and  the  general  education  system. 
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Basically,  there  are  two  formal  policy  linkages  between  the  job  skills  train- 
ing and  GED  systems:  (1)  thp  Academic  Remedial  Training  CART)  program  for 

identified  low  literate  personnel  and  (2)  the  required  educational  opportuni- 
ties/ services  orientation  given  to  all  new  personnel  within  30  days  of  their 
arrival  at  a new  duty  station.  For  all  intents  and  purposes,  there  are 
no  content  linkages  between  the  job  skills  training  and  the  GED  systems. 

The  general  plan  designed  for  a job-related  reading  training  program 
consists  of  immediate  and  long-range  changes.  The  immediate  changes  are 

(1)  to  tighten  existing  policy  (formal)  linkages  between  the  components 
of  the  Navy's  training  system  and  (2)  to  increase  the  content  linkages 
between  recruit  training  and  ART.  The  long-range  changes  are  (1)  to  de- 
velop individual  job-related  reading  programs  for  personnel  in  Class  A 
schools,  in  recruit  training,  and  assigned  to  permanent  duty  stations,  and 

(2)  to  integrate  these  reading  programs  into  the  job  skills  training  system. 

Conclusions 

1.  It  appears  that  the  NRTI/T  approach  can,  with  additional  refinement, 
be  used  effectively  to  assess  the  reading  demands  of  Navy  ratings,  as  well 
as  to  provide  information  on  job-related  reading  curricula  and  objectives. 

2.  Inspection  of  the  career  counseling  system  indicates  that  reading 
could  act  as  a barrier  to  advancement  for  a substantial  number  of  enlisted 
personnel  and  that  the  Navy  does  not  have  any  systematic  approach  to  literacy 
training. 

3.  Even  though  there  are  limited  linkages  between  the  components  of  the 
Navy's  training  systems,  it  does  seem  quite  possible  to  utilize  the  current 
system  in  the  development  of  the  integrated  job  skills/reading  skills  train- 
ing system  with  only  minor  modifications. 

Recommendat ions 

To  improve  the  job  proficiency  of  personnel  while  reducing  the  costs 
of  training,  it  is  recommended  that: 

1.  The  training  programs  be  systems  engineered  and  self-paced  to 
reduce  training  time. 

2.  Training  time  be  reduced  for  reading  programs  such  as  ART  by  con- 
verting general  reading  training  into  job-oriented  reading  training  and 
then  integrating  the  job  skills  and  reading  skills  training. 

3.  The  effectiveness  of  reading  training  be  increased  by  converting 
GED  programs  into  job-related  reading  programs. 
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INTRODUCTION 


Problem 

Over  the  years,  the  Armed  Services  have  pursued  training  research  and 
development  efforts  focused  on  methods  for  adapting  the  training  system 
to  individual  differences  in  the  trainee's  cognitive  and  the  affective 
processes.  Recently,  research  and  development  efforts  have  also  been 
initiated  for  studying  methods  for  providing  training  that  would  help  the 
learner  to  become  a more  adaptive  person  by  improving  his  basic  learning/ 
communication  skills  within  the  context  of  an  adaptive  training  program. 

That  is,  the  Job  skills  training  program  is  designed  to  adapt  to  the  indi- 
vidual learning/communication  needs  of  the  trainee,  while  simultaneously 
providing  additional  training  to  improve  those  learning/communication  skills 
in  which  he  appears  to  be  deficient.  If  the  Armed  Forces  are  to  prepare 
personnel  to  function  in  the  more  compact,  technically-oriented  military 
force  of  the  future,  their  future  R&D  efforts  must  focus  on  producing  more 
adaptive  training  programs  and  more  adaptive  personnel. 

Background 

Work  in  this  area  in  the  Navy  has  been  undertaken  at  the  Navy  Personnel 
Research  and  Development  Center  (NAVPERSRANDCEN) , San  Diego,  California,  by 
Duffy,  Carter,  Fletcher,  and  Aiken  (1975)  in  an  R&D  program  that  focuses 
initially  on  improving  skills  for  performing  tasks  involving  written  materials. 

To  complement  this  and  other  NAVPERSRANDCEN  efforts  to  improve  Navy 
training  programs  and  to  enhance  the  learning  strategies  and  basic  cap-  j 

abilities  of  Navy  personnel,  the  Human  Resources  Research  Organization 
(HumRRO)  was  contracted  to  study  literacy  skills,  primarily  reading  skills, 
in  relation  to  various  Navy  ratings  and  at  various  stages  of  an  enlisted 
person's  career. 

The  HumRRO  effort  was  conducted  in  two  phases.  The  first  phase,  which 
was  documented  in  NPRDC  TR  77-40  (Stlcht,  Fox,  Hauke,  & Zapf,  1977)  was  a 
study  of  the  role  of  reading  and,  to  a lesser  extent,  writing  skills  within 
the  context  of  the  Navy's  occupational  and  career  development  system.  In 
this  study,  a structured  Navy  Job  Reading  Task  Interview  was  administered 
to  a sample  of  enlisted  personnel  composed  of  students.  Instructors,  and 
job  performers.  The  interview  consisted  of  three  sections.  The  first 
section  was  designed  to  obtain  data  on  general  reading  and  writing  activi- 
ties; and  the  second,  to  elicit  specific  Job  reading  task  data;  that  is, 
reading  that  is  required  to  complete  a Job  task.  The  third  section  was 
concerned  with  personnel  attitudes  toward  the  Navy  training  system,  reading 
problems,  and  reading  training. 

Data  obtained  from  the  structured  Interview  indicated  that  reading  and 
writing  skills  are  widely  used  in  Navy  school  and  Job  settings,  and  that  the 
use  of  these  skills  appears  to  increase  in  the  more  technical  or  data-oriented 
ratings  and  at  the  higher  rates.  Subjects  Indicated  that  reading  problems 
were  experienced  by  20  percent  of  students  in  both  Class  A schools  and  rate 
training  courses,  by  15  percent  of  persons  in  recruit  training,  and  15  per- 
cent of  those  who  were  performing  on  the  Job.  At  least  one  fourth  indicated 
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that  they,  themselves,  had  "some  difficulty"  in  understanding  the  materials 
used  in  each  of  these  four  career  activities. 

Many  Navy  personnel  felt  that  they  could  benefit  from  reading  training, 
particularly  if  that  training  were  job-oriented.  However,  they  do  not  re- 
gard everything  taught  in  job  skills  training  programs  as  relevant  to  their 
jobs.  In  many  cases,  what  was  taught  was  viewed  as  being  of  more  importance 
for  passing  the  Navy-wide  exam  than  for  doing  the  job.  This  suggests  that 
the  job  skills  training  programs  might  benefit  from  systems  engineering 
oriented  towards  reducing  "nice-to-know"  course  content,  with  increased 
emphasis  on  mastery  of  "need-to-know"  content. 

Further  Information  obtained  during  the  interview,  dealing  with  the 
importance  of  off-duty  education  for  job  performance,  indicated  that  be- 
tween 75  to  95  percent  of  the  personnel  had  not  had  any  off-duty  education 
which  they  viewed  as  relevant  to  their  job.  Of  seven  job  performers  who 
reported  off-duty  education,  only  two  said  it  was  important  for  their  pre- 
sent job;  none,  for  the  Navy-wide  exam;  and  one,  for  a new  job.  Thus,  al- 
though Navy  personnel  seem  favorably  disposed  toward  training  that  improves 
their  job  skills.  Including  job-related  reading  training,  they  apparently  do 
not  utilize  the  current  education  system  to  a great  extent,  at  least  in  part 
because  it  is  not  considered  relevant  to  either  their  job  duties  or  their 
opportunities  for  career  development. 

These  findings  suggest  the  possibility  of  designing  a comprehensive  job- 
related  literacy  training  system  for  Navy  personnel  that  would:  (1)  systema- 

tically relate  to  job  reading  demands  and  career  development,  and  (2)  provide 
a job-functional  context  for  the  teaching  of  skills  and  knowledges  needed 
to  successfully  accomplish  job  reading  tasks  at  the  highest  rung  of  the 
career  ladder.  Through  the  development  of  closer  linkages  between  the 
general  educational  development  system  and  the  job  skills  training  system, 
it  should  be  possible  to  develop  a training  system  that  is  both  adaptive 
to  the  needs  of  individuals  in  the  Navy,  and  capable  of  producing  a more 
adaptive  individual  whose  basic,  generic  skills  render  him  more  generally 
useful  to  the  Navy,  to  the  society  at  large,  and  to  himself. 

Purpose 

The  purpose  of  the  second  phase  of  the  HumRRO  effort  then,  which  is 
documented  in  this  report,  is  to  design  a general  plan  for  the  develop- 
ment of  an  Integrated  job  skills/reading  skills  training  system.  * 
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ArPROACH 


The  complete  design,  development,  and  evaluation  of  a career-oriented 
literacy  training  system  is  a large  undertaking,  requiring  considerable 
time,  money,  manpower,  and  facilities.  It  is  Important,  therefore,  that 
the  R&U  work  proceed  in  a systematic  ruanner  according  to  a carefully  pre- 
pared plan.  This  plan  must  permit  the  achievement  of  the  ultimate  goals  of 
the  R&D  program  within  the  constraints  of  the  Navy  as  an  operational  system. 

Figure  1 presents  a general  plan  for  producing  a comprehensive,  integrated 
job  skills  and  literacy  skills  career  development  system  in  the  Navy.  The 
first  step  of  the  plan  calls  for  a thorough  analysis  of  reading  within  the 
Navy,  including  the  determination  of  general  reading  levels  for  performing 
job-related  reading  tasks  so  that  reading  training  objectives  rviy  be  tar- 
geted to  job  requirements.  In  this  regard,  Sticht  et  al . (1Q77)  have  pre- 
sented information  of  a g.eneral  nature  about  reading  in  the  Navy.  Next, 
methodologies  were  examined  for  making  more  precise  determinations  of  the 
reading  demands  of  Navy  ratings.  This  examination  includes  a brief  discussion 
of  various  methods  that  have  been  developed  for  determining  reading  demands 
of  jobs  by  military  and  civilian  research  organizations.  Also,  results  are 
presented  for  exploratory  research  by  the  present  project  to  develop  a Navy 
Reading  Task  Inventory  for  determining  reading  demands  of  Navy  ratings. 

An  additional  aspect  of  the  step  1 activities  given  in  Figure  1 is  the 
study  of  job  skills  training  and  the  general  education  system  within  the 
Navy  to  determine  the  feasibility  of  improving  linkages  in  these  systems, 
and  potential  for  revising  these  systems  to  produce  a more  integrated  job 
skills  and  literacy  skills  training  system.  Information  relevant  to  these 
career  development  subsystems  was  obtained  via  site  visits  to  Navy  Training 
Centers,  interviews  with  cognizant  Navy  and  civilian  training  personnel, 
and  review  of  relevant  Navy  and  civilian  literature.  This  information  is 
discussed  in  relation  to  the  design  of  an  integrated  job  skills  and  literacy 
skills  system  having  tlie  components  indicated  in  step  2 of  Figure  1. 
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DETERMINING  READING  DEMANDS  OF  NAVY  RATINGS 
Methods  for  Establishing  Job  Reading  Demands 

In  the  past,  the  reading  demands  of  civilian  and  military  jobs  have  been 
stated  (1)  in  terms  of  the  types  of  reading  materials  and  reading  tasks  the 
job  involves  (the  summary  task  statement  method),  and  (2)  as  a single  index 
number  denoting  the  reading  grade  level  (RGL)  of  ability  needed  to  perform 
well  on  the  job  (the  summary  index  number  method). 

Summary  Task  Statement  Method 

In  this  approach,  job  analysts  or  others  Interview  management  per- 
sonnel, and  sometimes  workers,  to  determine  whether  or  not  a given  job  re- 
quires reading.  If  so,  a simple  statement  to  that  effect  is  recorded  in 
the  job  description.  An  example  of  this  approach  is  Army  Regulation  611-201 
(5  Jan  67),  Enlisted  Military  Occupational  Specialities,  which  says,  fur 
example,  that  the  field  radio  repairman's  job  "requires  verbal  and  reason- 
ing ability  to  read  and  understand  technical  material  pertaining  to  main- 
tenance of  field  radio  equipment,"  and  that  the  ground  vehicle  repairman's 
job  "requires  verbal  and  reasoning  ability  to  read  and  understand  teclinical 
materials  pertaining  to  equipment  being  maintained."  Although  such  job 
statements  are  found  in  documents  throughout  the  Armed  Forces,  they  arc 
inadequate  for  determining  training  objectives  or  curricula  to  develop 
reading  skills.  For  such  purposes,  more  detailed  descriptions  of  the 
various  reading  tasks  performed  are  desired. 

In  the  first  phase  of  this  project,  the  authors  ejiiployed  a check- 
list of  materials  (e.g.,  notices,  messages,  and  manuals)  that  people  commonly 
read  on  the  job  to  specify  reading  tasks  (Sticht  et  al . , 1977).  Sharon  (1972) 
used  a similar  method  to  determine  what  kinds  of  materials  are  road  by  adults 
in  the  United  States.  Although  such  methods  identify  what  people  read  more 
precisely  than  does  the  task  statement  approach,  they  fail  to  identify  why 
people  read  certain  materials,  how  difficult  the  materials  are,  or  how  often 
the  materials  are  used. 

A recent  project  by  the  Department  of  Manpower  and  Immigration  of 
Saskatchewan,  Ganada  has  refined  the  summary  task  statement  method  (Smith, 
1975).  The  reading  tasks  performed  in  various  career  fields  were  analyzed 
to  find  out  both  what  kinds  of  materials  (e.g.,  notes,  memos,  letters,  direc- 
tions, instructions,  policy  manuals,  .and  procedural  manuals)  are  read  and 
why  they  are  read  (e.g.,  to  locate  and  understand  the  main  point  or  area, 
to  follow  directions,  to  put  details  in  order,  to  notice  and  interpret  ho', 
facts  or  details  are  related,  and  to  nvike  comparisons).  To  obtain  this 
Information,  Interviewers  depicted  the  genertil  type  of  material  they  were 
talking  about.  For  instance,  to  determine  if  a given  job  required  the 
reading  of  graphs,  two  graphs  were  shown  and  Interviewees  were  asked  to 
indicate  whether  or  not  they  read  similar  graphs  in  performing  their  jobs. 

This  method  of  deriving  summary  task  statements  deals  not  onlv  with 
what  must  be  read  in  greater  detail,  but  also  with  why  a person  reads  that 
material.  Additionally,  tlie  Ganadlan  work  has  d 1 st  ingu  i slied  entrv-level 
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from  advanced  level  reading  requirements  by  asking  respondents  to  Indicate 
what  reading  tasks  they  performed  (1)  when  they  first  entered  the  job  and 
(2)  at  present. 

The  Canadian  m.ethod  clearly  provides  more  useful  information  than  the 
typical  summary  task  statement  or  list  of  materials.  If  curriculum  planners 
know  the  types  of  reading  tasks  performed  in  different  occupations,  they 
can  include  activities  for  training  people  to  perform  these  tasks.  Also, 
they  can  design  curricula  to  Include  instructional  tasks  using  materials 
similar  to  those  used  in  various  career  fields. 

Even  though  the  Canadian  approach  far  surpasses  the  typical  summary 
task  statement  in  specification  of  reading  tasks,  it  still  fails  to  precisely 
specify  reading  tasks.  For  instance,  the  questions  of  what  materials  job 
holders  read  and  why  they  read  are  asked  separately,  without  reference  to  one 
another.  Thus,  although  we  learn  that,  in  a given  job,  a person  reads  policy 
manuals  and  this  same  person  reads  to  follow  directions,  we  do  not  know  that  he 
reads  to  follow  directions  in  policy  manuals.  A more  explicit  statement  of  a 
reading  task  would  include  both  a statement  of  what  was  read  and  why  it  was 
read . 

Summary  Index  Number  Method 

There  are  five  common  methods  of  assigning  summary  index  numbers 
to  job  reading  demands:  (1)  educator  estimates,  (2)  job  analysts'  judg- 

ments, (3)  readability  formulas,  (4)  correlation  of  reading  and  job  pro- 
ficiency measures,  and  (5)  job  reading  task  tests. 

Educator  Estimates.  Perhaps  the  most  widely  used  method  for  stating 
job  reading  demands  is  the  reading  grade  level  (RGL)  index  number.  This 
apparently  is  because  the  need  to  state  reading  demands  of  jobs  has  usually 
accompanied  the  need  for  literacy  training.  For  instance,  in  World  War  II, 
the  Army  was  required  to  establish  literacy  training  for  many  low  literate 
personnel  (Goldberg,  1951).  That  training's  goal  was  to  bring  reading  skills 
up  to  the  level  typically  achieved  by  children  in  the  4th  grade.  The  Navy 
set  up  a similar  program  for  its  recruits,  with  a nominal  goal  of  achieving 
5th  grade  reading  proficiency  (Fletcher,  1976).  These  levels  were  estab- 
lished by  educators  as  estimates  of  the  minimal  reading  demands  of  Army  and 
Navy  jobs.  Since  WW  II,  whenever  large  mobilization  efforts  have  resulted 
in  the  induction  of  large  numbers  of  marginally  literate  personnel,  the 
Armed  Forces  have  all  established  reading  training  programs  whose  goals 
were  represented  by  RGL  Index  numbers  (Stlcht  6 Zapf,  1976). 

Job  Analysts'  Judgments.  In  civilian  settings,  the  Department  of 
Labor  (DOT)  has  sought  ways  to  establish  the  reading  demands  of  jobs,  for  use 
in  programs  aimed  at  providing  marginally  literate  persons  with  marketable 
reading  skills.  In  the  DOL  approach,  job  analysts  estimate  the  levels  of 
General  Educational  Development  (GED)  required  for  various  jobs,  based  on 
Interviews  with  job  performers  and  supervisors,  and  on  observation  of  the 
job  being  performed.  Jobs  are  then  categorized  as  requiring  one  of  six 
levels  of  GED  that  roughly  parallel  school-based  educational  development. 

For  example,  a GED  of  level  1 approximates  the  education  obtained  In  grades 
1-3  and  level  2 parallels  that  of  grades  4-6  (Phillips,  1970). 
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This  approacli,  like  tlie  first,  is  judgmental.  Although  relatively 
low  in  cost,  the  lack  of  specificity  in  tlie  rules  for  arriving  at  a judg- 
ment of  the  GED  level  (and,  hence,  the  reading  level  of  the  job)  and  the 
absence  of  empirical  information  to  validate  the  estimates  render  this 
method  too  imprecise  and  uncertain  for  establishing  reading  demands  of 
jobs. 

Readability  formulas.  The  development  of  specially  constructed 
readability  formulas  makes  possible  a relatively  low  cost  method  for  es- 
timating reading  demands  of  jobs.  By  applying  a readability  formula  to 
samples  of  job  reading  materials,  an  average  RGL  of  difficulty  for  the 
materials  can  be  computed  and  used  to  represent  the  reading  requirements 
of  the  job  or  job  training  program. 

Readability  formulas  have  typically  been  constructed  by  two  means. 

In  one  approach,  prose  passages  from  school  textbooks  of  various  grade 
levels  are  sampled  and  features  such  as  average  sentence  length  and 
the  number  of  one-syllable  words  in  100  words  are  determined  (Fry,  1968). 
Tiiese  features  are  then  used  in  correlational  analyses  to  find  out  how 
well  they  can  be  used  to  predict  the  school  grade  level  of  the  nmterlal. 
Generally,  average  sentence  length  and  word  length  increase  as  materials 
from  higher  grades  are  sampled.  Because  of  this  positive  correlation, 
it  is  possible  to  determine  average  values  for  features  such  as  sentence 
and  word  length,  enter  these  values  in  a regression  equation,  and  then 
state  that  materials  having  those  values  are  typically  found,  say,  in 
the  6th  grade  of  school. 

However,  since  this  approach  does  not  involve  any  direct  measure 
of  people's  abilities  to  comprehend  the  materials,  it  is  not  known  what 
percentage  of  6th  grade  students  can  actually  comprehend  the  material 
having  the  structural  features  typical  of  materials  found  at  the  6th 
grade.  For  this  reason,  most  readability  formulas  have  been  constructed 
to  relate  features  of  textual  material  such  as  sentence  and  word  lengtli 
to  performance  or  tests  of  comprehension.  An  RGL  is  then  assigned  to 
the  material  by  setting  a criterion  of  accuracy  on  the  comprehension 
test,  say  70  percent  correct,  and  determining  the  earliest  grade  level 
at  which  some  designated  proportion  of  people,  say  50  percent,  attain 
that  score  on  the  comprehension  test.  If,  on  a given  comprehension  test, 
it  was  not  until  the  6th  grade  that  50  percent  of  the  students  got  70 
percent  correct,  that  material  would  be  assigned  a 6th  grade  reading 
difficulty  or  readability  value. 

To  use  such  a formula  to  determine  job  reading  demands,  one  must: 

1.  Identify  job  reading  materials. 

2.  Sample  the  materials  representatively, 

3.  Calculate  the  critical  features  (e.g.,  average  sentence  length). 
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4.  Use  these  features  in  the  readability  formula  to  obtain  an 
estimate  of  the  comprehension  score  70  percent  of  the  people  would  get  if 
they  were  to  take  a comprehension  test  like  the  one  used  to  construct  the 
formula. 

5.  Convert  that  score  to  a grade  level  score  using  appropriate 
tables  (if  step  4 provides  a direct  estimate  of  reading  difficulty  in 
reading  grade  score  equivalents,  step  5 is  unnecessary). 

6.  Obtain  the  average  RGL  of  all  the  materials  sampled.  This  is 
the  RGL  demanded  by  the  job. 

There  are  a number  of  problems  in  using  this  approach  to  determine 
( the  reading  requirements  of  jobs.  First,  it  depends  not  only  on  the  features 

of  the  text  materials,  but  also  on  the  comprehension  test  items,  the  criterion 
set  as  the  acceptable  score  on  the  test  (e.g.,  70%  correct),  and  the  criterion 
; set  for  the  proportion  of  people  at  each  grade  level  (e.g.,  50%)  who  must 

achieve  the  criterion  score.  For  example,  in  an  Army-sponsored  study,  Caylor, 

' Sticht,  Fox,  and  Ford  (1973)  found  that  they  could  increase  the  RGL  assigned 

to  some  materials  by  as  much  as  two  to  three  levels  merely  by  increasing  the 
criterion  score  on  the  comprehension  test  from  30  to  35  percent  correct. 

Second,  in  using  this  method,  it  may  not  be  possible  to  obtain  a 
, representative  sample  of  job  materials  or  even  to  determine  the  proper  do- 

main of  materials  from  which  sampling  should  be  done.  In  this  regard,  a 
I major  difficulty  can  arise  due  to  the  distinction  between  formal  job  task 

i specifications  and  the  actual  or  informal  job  tasks  that  are  performed  daily, 

i If  persons  consulted  regarding  reading  materials  used  in  doing  a job  base 

their  statements  on  their  conception  of  the  formal  job,  they  are  likely  to 
list  materials  that  no  one  could  reasonably  be  expected  to  use  in  his  normal 
work-day  activities.  Also,  interviews  with  employees  may  produce  a distorted 
sample  of  job  reading  materials,  either  through  willful  exaggeration  or  unin- 
tentional omission. 

Finally,  readability  measures  tend  to  set  reading  requirements  some- 
what higher  than  do  the  other  empirical  methods.  For  example,  Gaylor  et  al. 

1 (1973)  showed  that  some  Army  jobs  would  require  12th  grade  or  higher  skill 

I levels  if  readability  factors  only  were  considered.  However,  since  many 

j'  persons  with  reading  skills  well  below  that  level  were  performing  success- 

fully  on  those  jobs,  their  findings  must  be  viewed  with  caution. 

j Correlation  of  Reading  and  Job  Proficiency  Measures.  A general  method 

I for  estimating  job  reading  requirements  is  the  traditional  psychometric  pro- 

I cedure  used  to  validate  selection  and  classification  tests.  In  this  proce- 

! dure,  performance  on  a reading  predictor  test  is  related  via  correlational 

i techniques  to  performance  on  a job  proficiency  test.  If  a sufficiently  high 

relationship  exists,  cut-off  scores  on  the  reading  predictor  variable  can  be 
selected  to  Increase  the  probability  of  obtaining  students  or  employees  who 
will  reach  an  acceptable  level  of  achievement  on  the  job  proficiency  criterion 
measures. 
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Sticht  (1975b),  in  conducting  research  for  the  Army,  applied  this 
procedure  to  determine  reading  demands  of  four  jobs:  cook,  mecianic,  supply 

clerk,  and  armor  crewman.  Some  400  experienced  men  in  each  rating  were 
administered  standardized  reading  tests  and  two  measures  of  job  proficiency; 
(1)  a 4-  to  5-hour  job  sample  test,  in  which  each  man  performed  job  tasks 
derived  from  job  and  task  analyses,  and  (2)  a paper-and-pencil  job  know- 
ledge test.  In  this  effort,  the  lowest  level  of  reading  used  to  establish 
the  reading  demands  of  the  job  was  defined  in  terms  of  quar tiles;  that 
is,  if  a person  was  performing  at  a level  below  75  percent  of  his  fellow 
job  performers,  and  if  his  performance  was  systematically  related  to 
reading  skill,  then  it  is  not  unreasonable  to  target  a reading  training 
program  at  a level  associated  with  not  being  overrepresented  in  the  lowest 
fourth  of  job  performers. 

It  should  be  noted  that  the  purpose  of  this  effort  was  to  derive  a 
goal  for  reading  training.  Since  all  persons  tested  were,  in  fact,  working 
in  their  jobs,  they  can  be  considered  as  successful  job  performers.  Hence, 
it  was  necessary  to  discriminate  among  successful  job  performers  to  derive 
goals,  for  reading  training. 

This  method  also  has  some  serious  limitations.  For  Instance,  since 
the  job  proficiency  measures  are  likely  to  be  only  indirectly  mediated  by 
knowledge  that  may  have  been  learned  by  reading,  the  relation  of  reading 
to  job  sample  performance  should  be  smaller  than  those  among  general 
reading  measures  and  job  reading  tasks  or  other  paper-and-pencil  measures 
of  job  proficiency.  This  consideration,  plus  the  fact  that  the  costs 
of  constructing  an  extensive  job-sample  test  and  administering  it  to 
a representative  sample  of  jobs  and  job  performers  are  prohibitive  would 
seem  to  mitigate  against  the  use  of  such  tests  for  all  but  fundamental 
research  purposes. 

Although  correlating  reading  skill  with  job  knowledge  rather  than 
with  job  proficiency  would  overcome  cost  and  administrative  difficulties 
and  permit  standardization,  the  language  skills  required  to  answer  test 
questions  may  be  very  different  from  those  required  for  job  knowledge 
demands.  Thus,  reading  test  scores  may  correlate  with  a knowledge  test 
not  because  of  the  reading  demands  of  the  job  but  because  of  the  language 
demands  of  the  test.  The  application  of  this  method  is  justified  only 
if  it  can  be  sliown  that  the  job  knowledge  test  reflects  job  proficiency 
and  that  job  knowledge,  ratlier  than  general  reading  skill  per  se,  was 
needed  for  scoring  well  on  the  job  knowledge  tests. 

Finally,  tills  method  provides  no  direct  indication  of  how  well  a 
person  must  read  to  perform  job  reading  tasks.  Many  job  tasks  can  be 
learned  and  performed  without  reading.  Obviously,  to  the  extent  tliat  job 
performance  requires  reading  and  job  knowledge,  the  job  knowledge  test  can 
reflect  tliese  dem.ands. 

Job  Reading  Task  Tests.  The  correlational  analysis  technique  can 
be  made  more  directly  relevant  to  job  reading  demands  by  relating  general 
reading  skill  to  performance — not  of  job  tasks  in  general,  but  rather  of  j(>b 
reading  tasks  (l.e.,  tasks  in  which  reading  is  required). 
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In  this  regard,  Stlcht  (1975b)  Interviewed  Army  cooks,  mechanics, 
and  supply  clerks  at  their  job  sites,  asking  them  to  Identify  reading  materials 
they  had  used  in  performing  some  job  task.  He  then  obtained  copies  of  these 
materials  and  analyzed  them  as  to  the  reading  tasks  Involved.  Tasks  such 
as  "reading  tables  of  contents,"  "reading  indexes,"  "reading  procedural 
directions,"  and  "reading  tables  of  standards  and  specifications"  were 
identified  and  used  in  constructing  special  job  reading  task  tests  (JRTT) 
to  test  individual  ability  to  perform  different  job  reading  tasks. 

The  JRTT  and  a general  reading  test  were  administered  to  several 
hundred  Army  personnel.  Results  were  then  used  to  relate  various  criterion 
levels  of  achievement  on  the  JRTT  to  the  general  RGL  of  ability  needed  to 
achieve  this  criterion. 

Thus,  it  was  possible  to  Indicate  general  reading  levels  associated 
with  various  criterion  levels  of  performance  on  the  job  reading  tasks  as  a 
group.  Given  this  information  and  a decision  about  the  criterion  level  of 
performance  that  job  performers  or  job  aspirants  should  display  on  the  job 
reading  tasks,  a general  literacy  requirement  can  be  estimated  for  each 
job. 


In  the  Army  research,  it  was  found  that,  if  a criterion  of 
excellence  was  chosen  such  that  70  percent  of  the  people  was  expected  to 
get  70  percent  correct  on  the  job  reading  tests,  the  general  reading  require- 
ment for  cooks  was  the  7th  grade  level;  mechanics,  the  8th  grade;  and  supply 
clerks,  the  12th  grade. 

Of  all  the  methods  presented  to  this  point,  the  job  reading  task 
method  represents  the  most  direct  approach  to  determining  job  reading  require- 
ments in  that  it  takes  as  its  criterion  measure  the  reading  score  on  the 
JRTT,  a sample  of  commonly  used  job  reading  materials.  To  the  extent  that 
(1)  the  passages  constituting  the  JRTT  represent  all  the  reading  tasks  of  the 
job,  (2)  the  tasks  people  are  asked  to  perform  on  the  JRTT  represent  tasks 
they  have  to  perform  on  the  job,  and  (3)  job  success  requires  performance 
of  these  tasks,  then  the  ability  to  read  the  JRTT  passages  is  the  ability 
to  perform  the  job  reading  tasks  and,  thus,  to  meet  the  job  reading 
requirement . 

It  should  also  be  noted  that,  using  the  JRTT  method,  reading  skill 
level  requirements  will  change,  depending  upon  the  criterion  of  performance 
selected.  The  problem  of  specifying  a criterion  must  be  dealt  with  in  any 
approach  to  the  determination  of  reading  requirements  in  which  criterion 
performance  measures  are  obtained.  The  question  is  one  of  "how  good  is  good 
enough?"  It  is  possible  to  say  that  all  people  should  be  able  to  perform 
all  reading  tasks  with  100  percent  mastery  but,  if  there  are  restricted  man- 
power pools  and  if  many  job  reading  tasks  are  quite  complex,  this  goal  would 
seem  unrealistic. 


10 


Development  of  the  Navy  Reading  Task  Invencory/Test  (NRTI/T) 

Because  of  the  shortcomings  noted  in  both  the  summary  task  statement 
and  the  summary  index  number  methods,  it  was  decided  to  incorporate  aspects 
of  both  in  determining  the  reading  demands  of  Navy  ratings.  Essentially, 
the  methodology  used  involves  a combination  of  the  approach  developed  by 
Smith  (1975)  to  determine  reading  requirements  of  Canadian  occupations  and 
the  job  reading  task  test  (JRTT)  method  developed  by  Sticht  (1975a)  for 
determining  reading  demands  of  Army  occupations. 

As  indicated  previously,  the  JRTT  method  involves  identifying  reading 
tasks  through  interviews  with  workers  and  using  these  tasks  in  constructing 
special  tests.  By  relating  performance  on  these  tests  to  that  on  a standardized 
reading  test,  it  is  possible  to  state  how  high  a general  reading  level  a 
person  needs,  on  the  average,  to  be  able  to  perform  at  a selected  criterion 
level  on  the  JRTT.  This  reading  level  then  represents  the  reading  demands 
of  the  job.  The  fact  that  the  JRTT  approach  uses  a direct  evaluation  of  a 
person's  ability  to  perform  test  items  using  job-related  reading  materials 
is  obviously  advantageous.  However,  it  also  is  disadvantageous,  because 
the  determination  of  reading  demands  of  each  job  requires  the  testing  of 
personnel  in  those  jobs.  On  the  other  hand,  the  Canadian  summary  task 
statement  method  uses  ai.  inventory  technique  to  determine  what  kinds  of 
materials  job  performers  read,  and  why  they  read  those  materials.  Although 
this  inventory  technique  can  be  used  in  any  number  of  jobs,  it  does  not 
provide  general  reading  levels  of  occupations. 

In  the  methodology  evaluated  in  the  present  study,  a Navy  reading  task 
inventory  and  test  (NRTl/T)  were  developed.  To  establish  reading  require- 
ments of  Navy  jobs  using  the  inventory  approach,  it  was  necessary  to  identify 
reading  tasks  performed  in  Navy  ratings  and  to  scale  those  tasks  according 
to  the  level  of  general  reading  ability  at  which  the  probability  of  being 
able  to  perform  the  task  equals  or  exceeds  some  judgmentally  established 
criterion.  With  this  Information,  the  reading  demands  of  a job  can  be 
established  by  computing  the  average  general  RGL  needed  to  perform  the  job 
reading  tasks  found  in  the  job  duty  position.  Procedures  for  accomplishing 
this  activity  Include  (1)  identifying  job  reading  tasks,  (2)  classifying 
reading  tasks  In  some  general  taxonomy  or  categorization  system,  (3)  con- 
structing the  Navy  Reading  Task  Inventory  (NRTl)  and  Test  (NRTT) , (4)  scal- 
ing the  reading  difficulty  level  of  Navy  reading  tasks,  and  (5)  weighting 
the  occurrence  of  different  casks  in  different  jobs  by  frequency  and  criti- 
cality of  per formance"  o obtain  the  average  level  of  difficulty  of  the  job 
reading  tasks. 

Identifying  Job  Reading  Tasks 

In  Sticht  et  al.  (1977),  specific  job  reading  tasks  were  defined  as 
enabling  subtasks  that  help  the  individual  accomplish  a specific  job  task. 

For  example.  If  a quartermaster  needs  to  verify  a computation  of  the  times 
of  sunrise  and  sunset  (job  task),  he  would  have  to  refer  to  the  Air  Almanac 
for  information  about  those  times  at  a given  latitude  and  date  (enabling 
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subtask),  and  verify  the  computation.  Two  types  of  enabling  subtasks — 
reading-to-do  and  read ing-to-learn — were  identified  based  on  the  type  of 
information  processing  required  to  perform  the  task.  A reading-to-do  sub- 
task involves  looking  up  or  reading  information  for  immediate  use  in  com- 
pleting a job  task;  and  a reading-to-learn,  reading  information  that  is  to 
be  retained  for  later  use.  Subjects  in  the  Sticht  et  al.  (1977)  study  (i.e., 
students.  Instructors,  and  job  performers  in  11  different  ratings)  were  asked 
to  provide  examples  of  both  types  of  reading  tasks.  A total  of  325  tasks 
was  obtained,  186  of  which  were  reading-to-do  tasks.  Because  70  percent 
of  the  tasks  reported  by  job  performers  fell  into  this  category  and  the  NRTI 
and  NRTT  were  focused  on  the  job  situation,  only  the  reading-to-do  tasks 
were  used  in  the  exploratory  development  of  the  NRTI  and  NRTT. ^ 

Classifying  the  Reading  Tasks 

The  first  step  in  the  reading  task  classification  procedure  was  to 
sort  them  into  the  following  three  job  type  groups  or  clusters  defined 
by  Sticht  et  al.  (1977): 

1.  Service/Maintenance,  consisting  of  Boatswain's  Mate,  Hull  Main- 
tenance Technician,  and  Mess  Management  Steward  ratings. 

2.  Technical  Maintenance/Repair,  consisting  of  Aviation  Structural 
Mechanic,  Electrician's  Mate,  Electronics  Technician,  and  Gunner's  Mate 
ratings . 


3.  Data,  consisting  of  Aviation  Storekeeper,  Personnelman , and 
Quartermaster  ratings. 

The  reading  tasks  within  each  job  cluster  were  then  examined  to 
determine  what  kind  of  skill  they  required  for  completion.  As  a result, 
two  types  of  skill  categories  were  established:  fact-finding  and  following 

directions.  In  the  case  of  fact-finding  skills,  it  was  assumed  that  the 
individual  already  knew  how  to  do  the  particular  job  but  needed  some  addi- 
tional information  to  complete  it.  For  example,  suppose  the  individual 
was  called  upon  to  rig  a certain  type  of  boom.  He  knew  how  to  accomplish 
the  task  but  needed  to  use  a manual  to  find  out  what  type  of  pulley  to  use. 

Following  directions  skills,  on  the  other  hand.  Involve  using  a 
manual  or  other  document  to  find  out  how  to  do  a job.  For  example,  suppose 
the  individual  was  called  upon  to  write  a notice.  If  he  did  not  know  how 
to  do  it,  he  would  have  to  consult  a correspondence  manual  for  step-by-step 
instruc  t ions . 


*A  complete  kit  of  300  specific  job  reading  tasks  was  developed  from  the 
interview  data,  including  job  reading  tasks  for  students.  Instructors,  and 
job  performers,  and  including  reading-to-learn  and  read i ng-to-do  tasks.  These 
materials  can  be  used  in  developing  job  reading  training  curricula  and 
additional  test  items. 
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Using  these  definitions,  Uiree  raters,  all  experienced  in  the  study 
of  job  reading  tasks,  sorted  the  186  tasks  into  one  or  the  other  of  these 
two  skill  classifications.  The  results  and  the  percent  of  initial  agreement 
among  the  three  raters  are  shown  in  Table  1.  Agreement  as  to  whether  a 
given  task  was  a fact-finding  or  following  directions  task  ranged  from  63 
percent  to  100  percent  of  the  tasks  on  the  first  sort.  Subsequent  discussion 
among  the  three  raters  resolved  disagreements. 


Table  1 

Initial  Agreement  Among  Raters  Sorting  Read ing-to-l)o  Tasks 


Table  2 shows  the  results  of  the  classification  analysis.  Most 
tasks  (N  = 110)  were  classified  as  fact-finding.  Instructors  and  job  per- 
formers utilized  fact-finding  skills  two  to  four  times  more  than  following 
directions  skills,  while  students  used  following  directions  skills  much 
more  than  fact-finding  skills  (except  those  in  the  Data  cluster). 


Table  2 

Classification  of  Fact-finding  and  Following  Directions  Tasks 


Rating 

Clusters 


Instructors 
FF  H) 


mm 


m 


I 


Finally,  the  186  tasks  were  analyzed  to  Identify  the  type(s)  of 
display  contained  within  each.  The  following  types  were  identified:  (1) 

text,  (2)  figures  (forms),  (3)  tables,  (4)  text  and  figures,  (5)  text  and 
tables,  and  (6)  tables  and  figures. 

The  initial  agreement  between  raters  on  this  classification  task 
ranged  from  80  to  100  percent  across  job  clusters.  The  average  agreement 
was  90  percent.  Discussion  among  the  raters  resulted  in  the  final  agreement 
shown  in  Table  3. 

Reading  tasks  requiring  either  fact-finding  or  following  directions 
skills  applied  to  the  six  display  types  were  found  in  all  of  the  ratings 
studied  and  represent,  at  an  abstract  level,  the  bulk  of  Navy  job  reading 
tasks  performed  in  the  course  of  doing  a job  task  in  a job  situation. 


Table  3 


Classification 

of  Job  Reading  Tasks  by  Type  of 

Display 

Display  Types 

Rating  Clusters 

Serv/Maint 

Tech/Maint 

Data 

Total 

FF 

FD 

FF 

FD 

FF 

FD 

FF 

FD 

Text 

16 

25 

24 

33 

25 

11 

65 

69 

Figures  (Forms) 

26 

12 

31 

25 

15 

6 

72 

43 

Tables 

7 

10 

12 

6 

20 

2 

39 

18 

Text  & Figures 

5 

9 

14 

9 

6 

3 

25 

21 

Text  & Tables 

0 

7 

1 

1 

7 

1 

8 

9 •' 

Tables  & 

Figures 

1 

0 

0 

0 

3 

0 

4 

0 

TOTAL 

55 

63 

82 

74 

76 

23 

213 

160 

^Thls  display 

type  was  deleted  from  subsequent  analysis  because  o 

f its  ; 

minimal  occurrence. 
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^ _ ^ 

Constructing  the  Navy  Reading  Task  Inventory/Test  (NRTl / T ) 


Development  of  the  NRTI.  To  develop  a concrete  set  of  reading  tasks 
to  represent  the  abstract  tasks  derived  in  the  classification  effort,  it  was 
necessary  to  find  displays  as  source  material  for  testing  fact-finding  and 
following  directions  skills  that  would  not  require  specific  job  knowledge 
but  yet  would  be  similar  to  the  materials  used  in  various  Navy  jobs.  The 
source  found  to  be  ideal  for  this  purpose  was  The  Bluejackets'  Manual,  which 
covers  a wide  range  of  material  relevant  to  all  Navy  ratings  and  is  the  basic 
manual  for  new  Navy  recruits. 


For  each  of  the  five  display  types,  three  examples — easy,  medium, 
and  difficult — were  selected  from  the  manual.  Selection  was  based  on  the 
judged  complexity  of  their  inforiruitlon  processing  requirements.  For  example, 
one  table  might  be  rated  more  complex  than  another  based  on  the  number  of 
rows  and  columns  or  tlie  amount  and  type  of  symbols  used.  Figures  might  be 
rated  more  or  less  complex  based  on  the  number  of  callouts  or  of  parts. 


Using  these  displays,  two  forms  of  tlie  inventory  were  constructed,  one 
for  job  performers  and  one  for  their  supervisors.  For  each  display  included 
in  the  inventory,  questions  were  asked  on  (1)  performance,  (2)  frequency, 
and  (3)  criticality  (i.e.,  consequences  of  making  an  error)  of  the  reading 
task.  The  questions  included  in  the  NRTl  for  performers  are  shown  in 
Figure  2;  and  those  for  s”pervisors , in  Figure  3. 
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(For  Fact-Finding  Displays) 

(1)  In  your  job  would  you  ever 
Irave  to  perform  reading  tasks 
using  material  like  this  to 
look  up  facts? 


(For  Following  Directions  Displays) 

(1)  In  your  job  would  you  ever  have 
to  use  material  like  this  to 
following  directions? 


If  YES 
Answer 
2 & 3 


If  NO 

go  to  next 
example. 


If  YES 
Answer 
2 & 3 


If  NO 

go  to  next 
example . 


(2)  How  frequently  do  you  perform  a reading  task  similar  to  this? 


1 to  3 


a year 


1 time 

each 

month 


2 to  3 
times 
a month 


1 or  more 
times 
each  week 


Dally 


(3)  What  might  be  the  consequence  of  a reading  error  with  this  type  of 

reading  task? 

1.  No  consequence. 

2.  I would  be  disciplined  and  some  time  would  be  wasted. 

3.  The  job  would  have  to  be  done  over  again  and  some  time  would  be 
wasted. 

4.  The  job  would  have  to  be  done  over  and  some  materials  would  be 
wasted . 

5.  The  job  would  have  to  be  done  over  and  some  people  would  be 
inconvenienced . 

6.  Equipment  would  be  damaged  or  lost. 

7.  I might  be  injured  or  other  personnel  might  be  injured. 


Figure  2.  Sample  of  job  performer  Inventory  form. 
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(For  Fact-Finding  Displays) 


(For  Following  Directions  Displays) 


(1)  Do  the  personnel  whom  yon 
supervise  perform  reading 
tasks  using  material  like 
this  to  look  up  facts? 


(1)  Do  the  personnel  whom  you 

supervise  perform  reading  tasks 
using  material  like  this  to 
follow  directions? 


YES  NO 


YES  NO 


(2)  Of  the  total  number  of  personnel  in  your  rating,  what  percentages 
must  be  able  to  jierform  this  type  of  reading  task? 


0 


10 


20 


30 


40 


50 


60 


70 


■ 80 


90 


100 


(3)  How  often  would  personnel  in  your  rating  perform  a reading  task 
similar  to  this? 


1 to  3 
times 
a year 


1 time 

each 

month 


2 to  3 
times 
a month 


1 or  more 
times 
each  week 


5 

Daily 


(4)  IThat  might  be  the  consequence  of  a reading  error  with  this  type  of 
reading  task? 


1.  No  consequence. 

2.  The  individual  would  be  disciplined  and  some  time  would  be  wasted. 

3.  The  job  would  have  to  be  done  over  again  and  some  tine  would  be 
wasted . 

4.  The  job  would  fiave  to  be  done  over  and  some  iruiterials  would  be 
wasted . 

5.  The  job  would  have  to  be  done  over  and  some  people  would  be 
inconvenienced . 

6.  Equipment  would  be  damaged  or  lost. 

7.  The  individual  mig.ht  be  injured  or  other  personnel  might  he 
in  j ured . 


Figure  3.  Sample  of  supervisor  Inventory  form. 


As  shown,  tho  supervisor's  Inventory,  in  addition  to  providing  his 
])erception  of  the  performance,  frequency,  and  criticality  of  a reading  task, 
also  obtains  an  estimate  of  the  percent  of  people  who  must  be  able  to  per- 
form it.  This  information  was  needed  for  use  in  conjunction  with  the  expec- 
tancy table  data  generated  by  the  NRTT  scaling  to  establish  the  task's  read- 
ing grade  difficulty  level. 

Pilot  Testing  of  NRTI.  The  experimental  NRTI  was  administered  to 
an  Electrician's  Mate  (EM),  a Gunner's  Mate  (GM) , an  Electronics  Technician 
(ET) , and  a Boatswain's  Mate  (BM)  to  determine  whether  or  not  personnel 
would  be  able  to  respond  to  information  displays  as  generic  displays  by 
ignoring  the  specific  content. 

Table  4 presents  the  results  for  the  responses  to  the  "frequency 
of  use"  question  for  the  four  Navy  personnel.  Some  indications  of  the 
degree  to  which  the  four  respondents  ignored  the  display's  content  can  be 
obtained  by  comparing  the  pattern  of  responses  with  the  person's  rating 
and  with  the  content  of  the  displays  ho  reported  using.  (It  should  be  re- 
called tlrat  an  attempt  was  made  to  use  display  types  of  three  levels  of 
complexity.)  Looking  at  the  fact-finding/text  ratings,  we  see  that  the  ET 
and  EM  personnel  said  they  used  all  three  samples  of  texts.  The  BM  reported 
that  he  used  no  texts  for  fact-finding,  but  he  did  report  using  figures 
similar  to  examples  in  the  inventory.  In  this  case,  both  of  those  displays 
dealt  with  content  of  special  relevance  to  Boatswain's  Mates:  one  with  fire 

hoses  on  ships;  the  other,  with  rigging.  A similar  situation  seems  likely 
in  the  case  of  the  GM  who  reported  using  only  a certain  text  for  fact-finding 
which,  incidentally,  contained  inforimition  about  weapons.  Both  the  GM  and 
BM  probably  were  responding  to  some  degree  to  the  content  of  the  display  and 
not  to  the  generic  type  alone,  while  the  ET  and  EM  appeared  to  be  responding 
only  to  the  abstract  category  represented  by  the  display. 

The  considerable  variation  shown  in  frequency  ratings  for  the  four 
men  indicates  that  the  use  of  the  frequency  rating  with  the  inventory  does 
result  in  differential  response  patterns,  at  least  among  individuals.  Whether 
or  not  differential  patterns  would  emerge  for  different  Navy  ratings  remains 
to  be  determined  through  a large-scale  survey. 

The  distribution  of  responses  to  the  frequency  categories  is  as 

follows: 

1.  1 to  3 times  a year — 9 percent. 

2.  1 time  eacli  month — 17  percent. 

3.  2 to  3 times  a month — 10  percent. 

4.  1 or  more  times  each  week — 28  percent. 

3.  Dally — 9 percent. 

A "0"  rating  (never)  was  assigned  to  32  percent  of  the  rending  tasks. 
Note  that  some  37  percent  of  the  t.nsks  were  rated  as  being  performed  either 
daily  or  one  or  more  times  e.nclt  week. 
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Tab  1 e 4 

Frequency  of  Usape  Results  from  Fxpl oratory  Study  of  NRTI 


Navy  Rating 


Display 

F.T 

EM 

CM 

BM 

Combined 

Type 

FF 

FD 

FF 

FD 

FF 

FD 

FF 

FD 

FF 

FD 

Table  of 

Contents 

4 

— 

4 

— 

4 

— 

0 

— 

3.0 

— 

Index 

4 

— 

4 

— 

2 

— 

1 

— 

2.8 

— 

Text 

Easy 

3 

3 

3 

5 

0 

0 

0 

0 

1.5 

2.0 

Medium 

1 

1 

4 

4 

5 

0 

0 

0 

2.4 

1.3 

Dif  f icult 

2 

2 

4 

5 

0 

0 

0 

4 

1.5 

2.8 

F igure 

Easy 

3 

2 

5 

5 

4 

2 

2 

4 

3.5 

3.3 

Med ium 

2 

1 

4 

4 

0 

0 

0 

4 

1.5 

2.3 

Difficult 

3 

2 

4 

4 

0 

0 

4 

4 

2.8 

2.5 

Table 

Easy 

— 

3 

5 

4 

5 

0 

0 

1 

3.3 

2.0 

Medium 

3 

2 

4 

5 

0 

0 

0 

0 

1.8 

1.8 

Difficult 

2 

1 

4 

4 

n 

0 

0 

0 

1.5 

1.3 

Text  & 

F igure 

Easy 

3 

0 

4 

4 

0 

0 

1 

3 

2.0 

2.3 

Medium 

3 

1 

4 

4 

5 

0 

0 

4 

3.0 

2.3 

Dif  f icult 

2 

0 

4 

4 

0 

0 

0 

0 

1 .5 

1.5 

Text  & 

Table 

Easy 

0 

2 

4 

4 

1 

0 

0 

0 

1.3 

1 . 5 

Med ium 

2 

2 

4 

4 

0 

0 

o 

3 

2.0 

2.3 

Dif f icul t 

1 

1 

4 

4 

3 

3 

5 

5 

3.3 

3.3 

Note ; Rating  scale  alternatives  were  coded  as  follows: 

1.  1 to  3 times  a year. 

2.  1 time  eacli  month. 

3.  2 to  3 times  a montii. 

4.  1 or  mort-  times  each  week. 

5.  Daily. 

A "0"  rating,  indicates  that  tin-  respondent  does  not  peifi'rm  tliis 
type  of  reading  task. 
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Results  of  the  ratings  of  consequences  of  reading  task  errors  are 
given  in  Table  5.  These  data  indicate  that,  as  with  the  frequency  ratings, 
a wide  dispersion  of  responses  is  obtainable  using  the  consequences  scale. 

Tte  most  frequently  estimated  consequence  was  injury  to  self  or  others  (7), 
and  it  occurred  most  frequently  with  the  figures  display. 

The  distribution  of  responses  to  consequence  categories  is  as 

follows: 

1.  No  consequence — 11  percent. 

2.  Disciplined;  some  time  wasted — 10  percent. 

3.  Job  done  over;  some  time  wasted — 13  percent. 

A.  Job  done  over;  materials  wasted — 5 percent. 

5.  Job  done  over;  people  inconvenienced — 3 percent. 

6.  Equipment  damaged  or  lost — 5 percent. 

7.  Injury  to  self  or  others — 25  percent. 

A "0"  (do  not  perform)  was  indicated  for  32  percent  of  the  examples. 

As  shown,  the  major  consequence  of  categories  2,  3,  and  5 above  is  the 
loss  of  time;  of  categories  A and  6,  the  loss  of  material/equipment;  and  7, 
harm  to  personnel.  Using  these  consequences  as  criticality  indices,  reading 
errors  leading  to  loss  of  time  would  be  least  critical;  to  loss  of  material/ 
equipment,  medium  critical;  and  harm  to  personnel,  most  critical.  Following 
this  thinking,  then  responses  of  2,  3,  and  5 can  be  assigned  a value  of  1; 
of  A and  6,  a value  of  2;  and  of  7,  a value  of  3.  These  values  will  be  used 
later  in  discussing  how  the  criticality  information  may  be  used  to  estimate 
the  reading  demands  of  Navy  ratings. 
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Table  5 


Consequence  Rating  Results  from  Kxploratory  Study  of  MRTI 


Navy  Rating 


Display 

Tyi^e 

Table  of  Contents 


Index 


Text  Easy 

Med ium 
Diff icult 


ET 

•'F  FD 


F,M 

FF  FD 


CM 

FF  FD 


BM 

FF  FD 


Figure 


Table 


Text  & 
Figure 


Text  & 
Table 


4 2 

7 

0 

0 ; 

7 7 

0 

0 

0 ( 

7 7 

0 

0 

0 ( 

3 4 

0 

0 

4 

7 3 

7 

0 

0 

7 7 

0 

0 

0 ( 

3 2 

1 

0 

0 ( 

2 2 

0 

0 

b ( 

2 2 

1 

1 

1 

Easy 

Medium 

Difficult 


Easy 
Medium 
Dif  f icult 


Easy 
Medium 
Diff icult 


Easy 

Medium 

Difficult 


Note : Rating  scale  alternatives  were  coded  as  follows: 

1.  No  consequence. 

2.  I would  be  disciplined  and  some  time  would  be  wasted. 

3.  The  job  would  have  to  be  done  over  again  and  some  time  would  be 
wasted . 

A.  The  job  would  have  to  be  done  over  again  and  some  m.iti>rial  would 
be  wasted. 

5.  Tlie  jol)  would  liave  to  be  done  over  again  and  some  peojile  would  he 
Inconvenienced . 

6.  Ef|uipment  would  be  damaged  or  lost  . 

7.  I might  be  Injured  or  other  pt-rsonnel  might  be  injured. 

A "0"  rating  indicates  tliat  tlie  respondent  does  not  perform  this  type 
of  reading  task. 
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Development  of  the  NRTT.  Development  of  the  Navy  Reading  Task 
Test  (NRTT)  consisted  of  writing  questions  for  the  display  types  used  in 
the  Navy  Reading  Task  Inventory  (NRTI)  (i.e.,  the  five  types  identified 
plus  the  Table  of  Contents  and  Index) . Using  the  examples  of  each  display 
type  from  the  inventory  (i.e.,  easy,  medium,  and  difficult),  three  forms 
of  the  NRTT  were  constructed  on  the  basis  of  judged  complexity.  These  tests 
were  labeled  Forms  E,  M,  and  D to  reflect  their  estimated  difficulty  level. 

The  forms  comprise  16  questions.  The  first  six  questions  of  each 
form  are  identical — three  concerned  with  the  Table  of  Contents;  and  three, 
with  the  Index.  Those  questions  are  designed  to  test  the  student's  search/ 
locate  skills.  The  remaining  ten  questions — five  requiring  fact-finding 
(FF)  skills  and  five,  following  directions  (FD)  skills — differ  for  each 
NRTT  form.  The  FF  and  FD  sets  of  questions  were  designed  so  that  one  ques- 
tion from  each  set  requires  the  use  of  one  of  the  five  identified  display 
types  (i.e.,  text,  figure,  table,  text  and  figure,  text  and  table).  The 
development  of  these  questions  was  based  on  a conceptual  analysis  of  the 
reading  task  differences  between  looking  for  a specific  piece  of  information 
to  complete  a task  that  one  already  knows  how  to  perform  (FF  skill)  and 
looking  for  information  that  tells  one  how  to  perform  a task  (FD  skills). 
Essentially,  the  difference  is  in  the  type  of  knowledge  the  person  has  before 
he  starts  the  reading  task — what  he  actually  does  with  text,  figures,  etc. 
in  performing  the  task  may  be  basically  the  same  in  either  case.  Although 
both  FF  and  FD  questions  involve  the  location  of  facts,  following  directions 
usually  consists  of  finding  out  "what  to  do  next."  Since  the  distinction 
between  FF  and  FD  material  is  not  always  clear,  the  FD  items  in  all  three 
forms  Involve  (1)  the  statement  of  a task  the  person  is  performing,  (2) 
a listing  of  one  or  more  steps  the  person  has  taken,  and  (3)  a question 
about  what  to  do  next. 

Appendix  A includes  (1)  Instructions  and  sample  questions  provided 
to  testees,  (2)  test  items  Included  in  NRTT  Forms  E,  M,  and  D,  and  (3)  the 
correct  answer  for  each  item.  As  shown,  for  both  FF  and  FD  items  (items 
7 through  16  on  all  forms),  data  was  provided  as  to  the  type  of  display  in- 
volved and  the  page  in  The  Bluejackets'  Manual  where  the  information  could 
be  found  (e.g.,  "Text  and  Table,  206"  for  item  11,  Form  E,  Page  A-7). 

Appendix  B presents  plates  containing  the  following: 

1.  Test  items  included  in  Forms  E,  M,  and  D,  juxtaposed  with  materials 
from  The  Bluejackets'  Minual  testees  were  to  use  to  answer  the  item. 

2.  Table  showing  the  percentage  of  personnel  at  each  RCL  (6  through 
14)  who  got  the  correct  answer  to  each  item.  These  results  were  used  in 
scaling  the  NRTT  items  for  difficulty — see  section  below. 

3.  Table  showing  the  frequency  of  performance  estimates  by  one  job 
incumbent  in  each  of  four  Navy  ratings. 

Scaling  the  NRTT  Items  for  Difficulty 

The  scaling  was  accompl isl^ed  by  administering  the  three  forms  of 
the  NRTT  to  247  Navy  trainees  undergoing  recruit  training  at  San  Diego, 
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California.  All  trainees  brought  their  own  copies  of  The  Bluejackets' 

Manual  to  the  testing  session  to  be  used  in  taking  the  NRTT.  In  addition 
to  the  NRTT,  trainees  were  also  administered  the  Compretiens ion  section  of 
Form  B of  the  Nelson-Denny  (ND)  Reading  Test  (1960).  Ttiis  test,  which  was 
selected  because  it  had  been  used  previously  in  Navy  studies  of  ttie  reading 
skills  of  A School  personnel  (Aiken,  Duffy,  & Nugent,  1976),  provides 
tables  for  converting  raw  scores  to  reading  grade  level  scores  over  the 

range  from  7.2  to  14.0.  For  tlie  purposes  of  tlie  present  study,  tiie  lower 

end  of  the  grade  level  conversion  table  was  extrapolated  downward  to  grade 

6.0. 

Testing  time  for  the  NRTT  was  45  minutes,  wliicli  appeared  to  be  suf- 
ficient for  everyone  to  complete  the  test.  This  was  indicated  both  by  ob- 
servations during  the  test  session,  and  by  the  very  low  rate  of  omissions 
of  questions  coming  near  the  end  of  the  test. 

Testing  time  for  the  ND,  on  the  other  hand,  which  was  20  minutes, 

was  clearly  not  sufficient  for  many  of  tlie  trainees,  as  indicated  by  the 
large  number  of  omissions  in  the  second  half  of  the  36-item  test.  This  is 
consistent  with  the  design  of  the  ND  which,  unlike  the  NRTT,  emphasizes 
speed  rather  than  power. 

Results  of  the  ND  testing  are  summarized  in  Table  6.  The  median 
reading  grade  level  of  this  sample  is  at  the  10th  grade  level,  which  is 
consistent  with  data  reported  by  Duffy  (1976),  using  a different  standardized 
reading  test. 


Table  6 

Frequency  Distribution  of  Nelson-Denny  RGLs  of  Navy  Recruits 


Reading  Grade 
Leve  1 

N 

Frequenc V 
(%) 

Gumul at i ve 
(%) 

6 

26 

1 1 

1 I 

7 

26 

1 1 

'y  > 

8 

21 

9 

31 

9 

25 

10 

41 

10 

41 

17 

58 

1 1 

14 

6 

64 

12 

28 

1 1 

75 

13 

16 

(1 

81 

14 

50 

19 

100 

TOTAL 

247 

100 

100 
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Table  7 presents  the  summary  statistics  for  the  three  forms  of  the 
NRTT  for  eacli  reading  grade  level  grouping  on  the  NI).  It  should  be  recalled 
that  each  form  of  the  NRTT  has  a total  of  16  possible  points.  The  data 
indicate  that,  in  terms  of  total  scores.  Form  F,  was,  as  planned,  the  least 
difficult  of  the  three  forms.  However,  Forms  M and  D are  not  noticeably 
different  in  overall  difficulty. 

As  shown  in  Table  7,  considering  the  tliree  NRTT  forms  together, 
across  all  grade  levels,  the  percent  of  correct  scores  ranges  from  58  to 
94  percent.  Thus,  even  the  poorest  readers  (6th  grade  level)  were  able 
to  perform  over  half  of  the  reading  tasks  on  the  more  difficult  forms. 

Overall,  the  rate  of  omissions  dropped  from  8 percent  across  the  three 
forms  for  6th  grade  level  readers  to  less  than  1 percent  for  10th  grade 
level  readers  and  beyond.  Thus,  most  people  attempted  all  items. 

Ihe  correlations  for  the  Nelson-Denny  reading  test  with  the  NRTT 
Forms  E,  M,  and  D were  .53,  .41,  and  .54,  respectively.  These  somewhat 
low  Pearson  r's  reflect  both  the  fairly  high  success  rate  on  the  three 
NRTT  forms  and  the  fact  that  a speed  test  is  being  correlated  with  a power 
test.  If  the  time  limits  for  the  NRTT  were  decreased,  the  rate  of  infor- 
mation processing  could  be  used  to  further  discriminate  among  trainees. 

Under  this  arrangement,  an  increase  in  the  size  of  the  correlation  coef- 
ficients for  the  NRTT  and  ND  tests  would  be  expected. 

Tables  8,  9,  and  10  sliow  the  proportions  of  the  total  sample  and 
of  each  general  RGI,  who  correctly  answered  each  item  on  each  NRTT  form. 

As  shown  in  Table  8,  on  Form  E,  only  two  items — 13  and  16 — had  overall 
accuracy  rates  of  below  79  percent.  Item  13  required  respondents  to  study 
a figure  to  determine  two  steps  that  must  be  performed.  Errors  on  this 
item  were  primarily  due  to  omission  of  one  step.  Errors  on  item  16  were 
primarily  errors  of  commission;  that  is,  in  entering  the  wrong  answer  in  the 
space  provided.  In  both  cases,  however,  responses  were  taken  from  the 
correct  source.  Thus,  although  only  40  percent  of  the  6th  grade  level 
readers  got  item  16  of  Form  E correct,  90  percent  of  them  were  able  to 
read/ interpret  the  situation  part  of  the  question  and  the  question  itself 
and  to  locate  the  specific  material  in  The  Bluelackets'  Manual  to  be 
used  to  answer  the  question.  However,  they  were  unable  to  extract/enter 
the  appropriate  information  needed. 

Of  the  seven  items  on  Form  M with  accuracy  rates  below  80  percent, 
one — //3 — is  a Table  of  Contents  item  that  also  occurs  on  Forms  E and  D. 

Because  accuracy  rates  are  above  80  percent  for  this  same  item  on  Forms 
E and  D,  the  70  percent  accuracy  rate  of  Form  M is  suspect.  Finally,  nine 
Items  on  Form  D liad  accuracy  rates  below  80  percent,  confirming  It  as  the 
most  difficult  form.  However,  on  an  Item-by-item  basis,  tliere  is  a mixture 
of  difficulty  levels  among  and  within  tlie  three  forms.  In  subsequent  rcsearcli 
these  items  could  be  reassembled  into  one  or  two  forms  having  a more  uniform 
difficulty  level . 
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Table  7 


Results  of  NRTT  and  Nelson-Denny  Testing 


ND 

RGL 

NRTT 

Form 

N 

Mean 

Median 

Standard 

Deviation 

Percent 
Correc  t 

6 

E 

10 

10.5 

11.5 

3.6 

70 

M 

6 

9.2 

9.5 

2.0 

58 

D 

10 

9.3 

8.5 

2.9 

58 

7 

E 

8 

11.3 

11.0 

1.7 

75 

M 

10 

11.0 

11.0 

2.3 

69 

D 

8 

10.4 

11.0 

2.5 

65 

8 

E 

7 

12.7 

13.0 

1.2 

85 

M 

5 

11.2 

12.0 

1.3 

70 

D 

9 

11.6 

11.0 

1.2 

73 

9 

E 

8 

13.0 

13.0 

0.5 

87 

M 

9 

12.7 

13.0 

1.7 

79 

D 

8 

9.8 

10.0 

3.1 

61 

10 

E 

11 

13.2 

13.0 

1.2 

88 

M 

19 

12.8 

13.0 

1.9 

80 

» 

11 

12.4 

13.0 

1.6 

78 

11 

E 

8 

12.9 

13.0 

1.6 

86 

M 

3 

12.0 

12.0 

1.0 

75 

D 

3 

12.3 

12.0 

0.6 

77 

12 

E 

7 

13.0 

13.0 

1 .2 

87 

M 

6 

12.5 

12.0 

1.8 

78 

D 

15 

12.5 

13.0 

2.1 

78 

13 

E 

6 

13.8 

13.5 

0.9 

92 

M 

5 

11.2 

12.0 

2.5 

70 

D 

5 

13.2 

13.0 

1.8 

83 

14 

E 

17 

14.1 

mBgm 

1 .0 

94 

M 

18 

13.4 

1.3 

84 

I) 

15 

13.3 

HhH 

1.4 

83 
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Table  8 


Percent  of  Personnel  (Jetting  Each  Item  Correct  on  the 
Experimental  Navy  Reading  Task  Test  (Form  E) 


Task/ 

General  Reading 

Grade 

Level 

of 

Personnel 

Material 

Item 

6 

7 

8 

9 

10 

11 

12 

13 

14 

Total 

Table  of 
Contents 

1 

80 

100 

86 

100 

91 

100 

100 

100 

100 

95 

2 

70 

100 

100 

100 

100 

88 

100 

100 

94 

94 

3 

80 

75 

100 

88 

82 

75 

71 

100 

88 

84 

Index 

4 

80 

75 

86 

100 

100 

88 

100 

100 

Rl 

93 

5 

90 

62 

86 

88 

91 

88 

100 

83 

Wm 

89 

6 

50 

75 

86 

88 

82 

100 

100 

100 

11 

87 

Finding  Facts 
Using: 

Texts 

7 

60 

62 

71 

88 

91 

62 

57 

100 

100 

79 

Figures 

8 

80 

50 

71 

62 

91 

75 

86 

83 

94 

79 

Tables 
Text  & 

9 

90 

100 

100 

100 

100 

88 

100 

100 

100 

98 

Figure 
Text  & 

10 

11^ 

90 

88 

100 

100 

100 

100 

100 

100 

94 

96 

Table 

Following 

Directions 

Using: 

Texts 

12 

70 

88 

100 

88 

91 

100 

86 

83 

100 

90 

F igures 

13 

20 

25 

14 

38 

55 

62 

57 

67 

59 

45 

Tables 
Text  & 

14 

90 

100 

100 

100 

91 

100 

86 

83 

100 

95 

F igure 
Text  (t 

15 

60 

75 

86 

100 

100 

100 

86 

100 

94 

89 

Table 

16 

40 

50 

86 

62 

55 

62 

71 

83 

82 

66 

N 

10 

8 

7 

8 

11 

8 

7 

6 

17 

82 

'^This  item  was  deleted  from  the  test. 
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Table  9 

Percent  of  Personnel  Getting  Each  Item  Correct  on  tlie 
Experimental  Navy  Reading  Task  Test  (Form  M) 


Task/ 

(Jeneral  Reading 

Grade 

Level 

of  Personnel 

Material 

Item 

6 

7 

8 

9 

10 

11 

12 

13 

14 

Total 

Table  of 
Contents 

1 

100 

90 

100 

100 

95 

100 

83 

80 

100 

95 

2 

50 

90 

80 

100 

95 

67 

100 

80 

94 

89 

3 

33 

60 

80 

78 

74 

67 

67 

80 

78 

70 

Index 

4 

83 

90 

80 

78 

100 

100 

100 

80 

100 

93 

5 

50 

90 

80 

89 

95 

100 

83 

80 

100 

89 

6 

50 

80 

100 

89 

95 

100 

8 3 

80 

100 

89 

Finding  Facts 
Using ; 

T ex  t s 

7 

100 

90 

100 

100 

100 

100 

83 

100 

100 

98 

Figures 

8 

50 

40 

60 

56 

68 

33 

50 

20 

56 

53 

Tables 

9 

83 

90 

100 

100 

95 

100 

100 

100 

100 

96 

Text  & 

F igure 

10 

33 

50 

0 

89 

47 

33 

50 

60 

56 

51 

Text  & 
Table 

11 

83 

90 

100 

89 

89 

67 

100 

100 

100 

93 

Fol lowing 
Direct  ions 
Using ; 

Texts 

12 

50 

90 

80 

89 

84 

100 

83 

100 

89 

85 

F igiires 

13 

33 

10 

20 

44 

63 

67 

6 7 

20 

56 

<6 

Tables 

14 

b7 

50 

40 

67 

79 

1 00 

hi 

60 

7 2 

(i8 

Tex  t ft 
Figure 

1 5 

3 3 

60 

80 

87 

84 

67 

100 

80 

83 

75 

Text  6. 
Tab  1 e 

15 

33 

60 

80 

67 

84 

67 

100 

80 

8 3 

75 

N 

6 

10 

5 

d 

19 

D 

B 

5 

18 

81 

Table  10 


Percent  of  Personnel  Getting  Each  Item  Correct  on  the  i 

Experimental  Navy  Reading  Task  Test  (Form  D)  < 


Task/ 

General  Reading 

Grade 

Level 

of  Personnel 

Material 

Item 

6 

7 

8 

9 

10 

11 

12 

13 

14 

Total 

Table  of 
Contents 

1 

70 

88 

100 

75 

90 

100 

100 

100 

100 

92 

2 

90 

88 

100 

75 

82 

33 

87 

100 

73 

83 

3 

100 

38 

89 

50 

91 

100 

87 

100 

80 

81 

Index 

A 

100 

100 

100 

75 

100 

100 

100 

100 

93 

96 

5 

100 

100 

89 

50 

72 

100 

87 

80 

93 

81 

6 

80 

75 

89 

88 

91 

100 

93 

80 

93 

88 

Finding  Facts 
Using : 

Texts 

7 

10 

63 

67 

38 

100 

100 

93 

100 

100 

75 

Figures 

8 

60 

50 

56 

75 

82 

67 

73 

80 

93 

73 

Tables 

9 

70 

88 

67 

50 

72 

100 

53 

60 

60 

64 

Text  & 
Figure 

10 

40 

75 

78 

75 

91 

100 

60 

80 

93 

75 

Text  & 
Table 

11 

30 

50 

67 

75 

64 

100 

80 

60 

87 

68 

Following 

Directions 

Using: 

Texts 

12 

40 

38 

78 

50 

73 

100 

87 

100 

100 

74 

F igures 

13 

20 

50 

22 

50 

27 

0 

20 

80 

40 

33 

Tables 

14 

20 

38 

22 

38 

46 

0 

80 

80 

67 

49 

Text  & 

F igure 

15 

30 

38 

56 

63 

55 

33 

67 

40 

67 

54 

Text  & 
Table 

16 

70 

63 

78 

50 

100 

100 

87 

80 

87 

80 

N 

10 

8 

9 

8 

3 

15 

5 

15 

84 

28 


Overiill,  on  tlio  three  forms  of  the  NRTT,  there  are  36  difr<'r<Mit 
items  (.3  TOC,  3 Index,  15  fact-finding,  and  15  following  directions).  Of 
tliese,  17  or  47  percent,  had  an  accuracy  rate  of  less  than  79  to  80  per- 
cent correct.  Of  those,  10,  about  60  percent,  were  following  directions 
items,  suggesting  that  the  additional  information  processing  involved  in 
many  of  ttie  I’D  items,  whicli  render  them  more  like  "problem  solving"  items, 
makes  them  more  difficult  to  answer  correctlv. 


Tlie  relationship  of  general  reading  ability  to  performance  on  tlu' 

NRTT  items  is  illustrated  in  Figure  4,  wliich  shows  that  for  tlie  48  reading 
tasks  attempted  by  6th  grade  level  readers  on  t iie  three  NRTT  forms,  42  per- 
cent of  the  tasks  liad  accuracy  rates  equal  to  or  less  tlian  50  percent.  The 
proportion  of  reading  tasks  luiving  this  accuracy  rate  decreased  to  a low'  o I' 

6 percent  averaged  over  the  12tli,  13th,  and  14th  reading  grade  levels.  Thus, 
the  probability  tliat  more  tlian  lialf  of  tlie  people  at  a reading  grade  level 
will  be  able  to  perform  a given  Navy  reading  task  shows  a seven-fold  decrease 
from  the  12th  to  14th  grade  level  to  the  6tl\  grade  level. 

W i t li  the  data  on  general  RCi,  ability  and  on  performance  on  tlie  Navy 
reading  tasks  given  in  Tables  8,  9,  and  10,  it  is  possible  to  determine 
the  proportion  of  people  at  various  general  ROl.s  wlio  can  successfully  com- 
plete each  Navy  reading  task  test  item.  For  instance,  we  can  see  that  40 
percent  of  6tli  grade  level  readers  can  successfully  complete  item  10  of 
Form  D (Table  10),  compared  to  93  percent  of  14th  grade  level  readers. 

To  establish  tlie  reading  difficulty  level  of  a given  Navy  reading 
task,  a judgment  must  be  made  concerning  the  proportion  of  men  at  a given 
general  ROL  who  must  be  able  to  perform  that  task.  In  general,  as  indicated 
in  Figure  4,  the  liiglier  tlie  proportion  of  people  wliom  the  Navy  would  like  to 
be  able  to  perform  a given  reading  task,  tlie  iiigiier  tiie  general  Rtd,  of  aliiiitv 
needed.  For  instance,  if  it  is  desired  tliat  93  percent  of  personnel  are 
able  to  do  tlie  task  described  in  item  10  of  Form  D,  this  will  require  a 14th 
grade  level  of  general  literacy.  If  it  is  desired  that  40  percent  of  per- 
sonnel perform  the  retiding  task,  this  criterion  will  be  met  bv  (leople  having 
a titli  grade  level  of  literacy.  Sinci'  tlie  actuoL  stringency  of  the  c-riterion 
level  may  reflect  the  n.it  ure  of  the  retidlng  task  and  its  frequency  and  'or 
c r i t i c.i  1 i t y , the  I'riti'rion  levels  of  pi'rformance  for  eacli  reading  task  must 
be  I'Stablished  in  consultat  ion  with  lob  supervisors  aiui  job  performers. 

It  should  be  rei-alled  that  the  Navy  Rcaillng  Task  Inventory  for  supervisors 
calls  for  a judgment  of  the  percentage  of  pt>rsonnel  in  the  su|ierv  i st>r ' s rating, 
that  must  be  able  to  pertorm  each  type  of  Navy  reading  task  represented  in 
the  NRTI. 


Once  this  percentage  criterion  is  established,  it  is  a simpU'  matter 
to  examine  Tables  8,  9,  and  10,  results  for  Forms  F,  M,  and  0 I'f  the  NRl'T, 
to  determine  the  lowest  general  KOI.  at  which  the  criterion  is  acliievi-d  for 
ii  given  reading  task,  wliicii  then  becomes  tiie  reading  ditficulty  level  el 
that  task. 


EstabllshinK  ReadinR  Requirements  for  Navy  Katinas 


Reading  requirements  for  Navy  ratings  are  established  by  combining 
the  information  about  the  reading  difficulty  level  of  Navy  reading  tasks  with 
the  data  on  tiie  frequency  and  criticality  of  reading  tasks  obtained  with  the 
NRTI  so  as  to  assign  more  weight  to  those  reading  tasks  of  greater  frequency 
and  criticality.  If  ail  tasks  are  equally  frequent  and  critical,  the  RCL 
will  simply  be  the  average  of  the  item  R(JLs  for  the  percent  passing  specified 
by  the  supervisor. 

To  illustrate  the  procedure  involved  in  using  the  frequency  and 
criticality  information  and  the  RGL  of  Navy  reading  tasks  for  determining 
the  general  reading  requirement  of  a Navy  rating,  the  fictitious  data  of 
Table  11  will  be  used.  This  table  shows  three  reading  tasks  that  were  cited 
as  being  performed  on  the  job  (by  one  or  more  persons).  The  first  task 
(Fac t-Tind ing , using  texts  as  represented  on  Form  E,  NRTT) , is  performed 
daily  (F  = 5),  and  an  i>rror  results  in  a loss  of  time  (C  = 1).  Supervisors 
have  indicated  that  80  percent  of  the  people  need  to  be  able  to  do  this 
type  of  reading  task.  Table  11  shows  that  on  Form  E,  Fact-Finding  using 
Texts,  it  is  at  the  9th  grade  reading  level  that  we  first  find  at  least  80 
percent  of  the  people  performing  the  task  accurately.  Thus,  the  task  is 
assigned  an  RGL  of  9.  Following  this  same  procedure,  the  data  for  the  Fact- 
Find  ing/  Figures  and  Tables  tasks  are  obtained. 


Table  11 

Hypothetical  Data  for  Illustrating  How  Reading  Grade  Levels 
Are  Determined  for  Navy  Ratings 


Navy  Reading 

Task 

Frt'quency  (F) 

C r i t i c .1 1 i t y ( C ) 

Ri'ad  i ng 
l.eve  1 

Grade 

(X) 

Fact  Finding 

I's  ing: 

(Form  E) 

I'exts 

'■) 

1 

(-) 

F igures 

3 

2 

'l  ab  I es 

2 

3 

b 

To  compute  the  reading  grade  level  for  a rating,  tlie  tdrmula  shown 
below  is  used.  This  formula  involves  adding  the  frequeiuy  and  i-riticalitv 
of  scores  for  each  reading  task  and  tlien  multiplying  the  RGl,  of  tin*  task  bv 
the  sum  of  tlie  fre(|uenry  and  criticality  scores.  Then,  t lu’  sum  of  eacli  ol 
the  products  resulting  from  the  preceding  opi’rat  ion  is  obtaiiuai.  Next,  all 
the  frequency  and  criticality  scores  are  added  to  obtain  an  overall  total 
for  these  scores.  This  total  is  then  diviiled  into  the  pteceding  sum,  and 
the  result  is  the  RGL  of  tin'  rating,  weighteil  by  the  Iretpiencv  and  criticalit-. 
of  the  reading  tasks.  In  the  example  shown  below,  the  RGl  tor  the  rating  is 
7.1. 


II 


+ 


RGL 


Rating 


[(F  + C)  Xj^j  + [(F  + C)  X2] 

( (F  + C)„  + (F  + C)„  + . 

A , A 


. . . |(F  + C)  X^] 

. . (F  + C)^  ] 
n 


^ [(5  + 1)9]  + [(3  + 2)6]  + [(2  + 3)6] 

[(5  + 1)  + (3  + 2)  + (2  + 3)] 

54+30+30  ^ 114 

16  16 

RGL  = 7,1 


Following  this  general  approach,  with  the  NRTI,  one  obtains  an 
indication  of  the  types  of  reading  tasks  Navy  personnel  perform  and  the 
frequency  and  criticality  of  these  tasks.  Used  in  conjunction  with  the  ex- 
pectancy tables  tliat  show  the  proportion  of  personnel  at  different  reading 
levels  who  perform  Navy  reading  tasks  correctly,  it  is  possible  to  calculate 
the  general  RGL  of  Navy  ratings. 

Critique  of  the  NRTI/T 

The  materials  and  procedures  described  in  this  section  for  determin- 
ing the  reading  tasks  performed  in  Navy  ratings  and  the  general  level  of 
reading  skills  required  by  these  raters  must  be  considered  of  an  experimental 
nature.  First,  only  four  Navy  job  performers  (EM,  GM,  ET , and  BM)  were 
administered  the  NRTI,  none  of  whom  was  a supervisor.  For  the  GM  and  BM, 
there  was  some  indication  that  they  were  responding  to  some  degree  to  the 
content  of  the  display  and  not  to  the  generic  type  of  task  alone.  Further 
research  to  develop  instructions  or  brief  training  periods  for  lielping  people 
to  better  understand  the  nature  of  the  task  might  help  remedy  this  problem. 

Second,  there  is  no  evidence  to  suggest  that  the  three  samples  of 
display  type  (texts,  figures,  etc.)  in  the  NRTI  actually  represent  different 
levels  of  complexity  or  that  they  were  responded  to  on  this  basis.  Indeed, 
there  Is  evidence  to  the  contrary,  Tlu>  last  item  of  each  NRTI  displayed 
three  passages  of  materials  that  had  been  previously  scaled  for  difficulty 
in  the  development  of  a readability  formula  (Sticht,  1975b).  The  four 
testees  were  asked  to  read  all  three  passages  and  rate  them  as  to  their 
difficulty.  Since  only  one  rater  agreed  with  the  original  scaling,  it  seems 
unlikely  that  the  testees  were  sensitive  to  differences  in  complexity  in 
the  three  -amples  for  each  display  type  as  they  completed  the  NRTI,  espe- 
cially since  they  were  not  instructed  to  attend  to  the  display  complexity. 
Further,  it  is  neither  certain  that  the  displays  are,  in  fact,  of  different 
complexity  levels  (oven  though  they  were  judged  as  such  by  the  NRTI  devel- 
oper) nor  that  the  dimension  of  complexity  was  tapped  in  the  NRTT  and  con- 
tributed to  the  difficulty  of  the  NRTT  items.  In  the  latter  case,  the 
difficulty  may  have  resided  in  the  questions  rather  than  the  materials  or 
In  a combination  of  the  materials  and  questions. 
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Despite  initial  editing,  some  NRTT  items  still  remain  ambiguous  and 
permit  a wide  range  of  responses  that  might  be  considered  correct.  This  is 
especially  true  for  the  following  directions  questions.  These  questions 
should  be  more  carefully  drafted  so  that  (1)  in  the  situation  component, 
the  reader  is  led  mentally  through  steps  of  a process,  and  (2)  the  question 
is  tlien  posed  as  to  what  step  or  steps  must  be  performed  next  to  reach  the 
desired  outcome.  In  Appendix  A,  Item  15  of  NRTT  Form  M (page  A-10)  illus- 
trates this  approach  fairly  well,  although  the  open-ended  response  format 
still  permits  a variety  of  responses  that  require  some  judgment  for  scoring. 
This  latter  problem  could  be  resolved  by  using  carefully  designed  multiple- 
choice  questions. 

Determining  whether  use  of  the  NRTI/T  presents  a valid  estimate  of  the 
reading  demands  of  Navy  jobs  is  a most  serious  problem.  It  may  be  easier 
to  know  that  an  approach  is  not  valid  than  to  know  that  one  is.  For  instance, 
a variety  of  methods  for  determining  reading  demands  of  jobs  was  reviewed 
earlier.  The  readability  method  is  an  empirical  method  that  can  be  performed 
by  clerks  or  computers.  However,  the  question  of  validity  seems  clear  with 
the  readability  approach:  It  in  no  way  involves  figures  and  tables  in  tlie 

estimate;  and,  as  we  found  in  the  structured  interview  (Sticht  et  al.,  1977), 
only  32  percent  of  the  reported  reading  tasks  involved  texts  only  while 
62  percent  used  figures  or  figures  and  texts  combined.  Thus,  simply  on  the 
basis  of  tlie  information  displays  involved,  tlie  readability  formula  approach 
does  not  appear  to  validly  represent  Navy  reading  tasks. 

As  mentioned  on  page  12,  the  structured  interview  produced  over  320 
specific  job  tasks  in  which  reading  subtasks  were  performed.  Perhaps  the 
most  valid  estimate  of  the  reading  difficulty  level  of  Navy  ratings  would 
be  obtained  by  liaving  personnel  of  various  reading  levels  perform  the  actual 
job  tasks  and  reading  subtasks  that  were  reported  to  have  been  performed. 

These  items  could  then  be  scaled  for  difficulty  as  in  tlie  present  study 
if  a "proper"  scoring  system  were  available.  Completion  of  the  job  task 
might  be  scored  but  perhaps  some  could  be  completed  even  though  some  or  all 
of  the  reading  material  was  not  understood.  There  is  no  way  one  can  know 
this.  Similarly,  the  importance  of  reading  speed  depends  on  a number  of 
situational  factors;  thus,  the  relative  importance  of  a speed  score  cannot 
be  specified  for  the  general  case.  Finally,  the  options  for  determining 
reliability  raised  a whole  new  sot  of  problems. 

From  all  this,  it  should  be  apparent  that  there  is  no  such  empirical 
"tiling"  or  "stuff"  or  "event"  or  "condition"  known  as  "the  rending  demands 
of  a job."  Keaciing  demands  are  not  d tscovered . tiiey  are  creat  eii  by  proce- 
dures that  ari'  more  or  less  systematic  and  performed  according  to  more  or 
less  Slice- 1 f i.ii)  1 e rules.  Thus,  the  (|uest  ion  of  the  va  1 iel  i t y of  anv  estimate 
can  onlv  be  .answered  in  respect  to  a model  or  theory  of  )ob-related  leading 
that  would  del  ine  svsteniat  ic  proi'edures  for  oht. lining  i>stim.ites  of  reading 
dem.ands  oi  jobs  for  various  purposes  permitted  by  the  theoret  ical  constructs 
Involved.  Iti  this  regard,  a general  moiU-l  for  a specif  ii-  job  ri-ading  task 
was  developed  in  the  Sticht  i-t  .1 1 . (1977)  study  ot  the  role  of  readin>’,. 

The  specific  job  shown  consists  ol  .a  number  of  steps.  With  e.ach  step,  theii- 
is  .an  implicit  qiu'Stion:  Do  I know  how  to  do  the  next  step?  11  the  answer 

is  yes,  the  person  proceeds  through  th.it  step  to  the  lu-xt  om-.  It  no.  he 


performs  a subtask  Involving  a general  operation  call  "read,"  which  acts 
on  a data  base  called  "material."  Information  is  extracted  by  the  "read/ 
material"  routine  until  the  job  task  step  can  be  performed,  and  the  per- 
son proceeds  through  the  task.  Although  this  model  defines  a job  reading 
task  so  that  the  goal  of  obtaining  samples  of  such  tasks  is  readily  achiev- 
able, ignorance  of  the  size  and  composition  of  the  domain  of  reading  tasks 
leaves  open  the  question  of  the  val id ity/representat iveness  of  the  sample. 

Although  this  model  is  useful  for  collecting  samples  of  reading  tasks, 
it  is  not  so  useful  for  developing  reading  task  tests.  In  this  case,  a 
theory  or  model  is  needed  for  constructing  reading  tests  that  can  be  applied 
to  the  sample  of  reading  tasks.  However,  to  be  certain  that  these  reading 
tests  match  the  information  processing  that  was  done  in  the  actual  perfor- 
mance of  the  reading  task  on  the  job,  the  theoretical  constructs  in  the 
reading  test  model  must  be  incorporated  into  the  interviews  or  other  approaches 
used  to  obtain  the  sample  of  reading  tasks.  Thus,  it  is  necessary  to  query 
people  about  their  information  processing  during  the  performance  of  a reading 
task,  in  order  to  discover  whether  or  not  they  perform  the  types  of  informa- 
tion processing  involved  in  the  model  of  reading.  This  was  the  approach 
taken  in  the  Sticht  et  al.  (1977)  study  of  the  role  of  reading  in  the  Navy. 

As  indicated  on  page  12,  the  186  reading-to-do  tasks  obtained  in  this  study 
were  used  in  the  development  of  the  NRTI/T  since  they  represented  75  percent 
of  the  types  of  reading  tasks  job  performers  reported. 

The  construction  of  the  NRTI  introduced  a host  of  new  conceptual/ 
procedural  problems.  For  instance,  is  it  possible  for  people  to  rate  their 
performance  of  generic  reading  tasks,  when  all  the  NRTI  can  present  is  a 
number  of  specific  displays  (texts,  figures,  tables,  etc.)  with  their  spe- 
cific content  and  (unspecified)  dimensions  of  complexity,  legibility,  etc.? 
Although  the  Canadian  study  (Smith,  1975)  has  presented  numerous  displays 
that  people  used  as  generic  displays  (even  though  each  display  was  a "species" 
of  the  "genus"),  that  study  did  not  have  any  way  to  determine  the  extent 
to  which  a genus  versus  a species  basic  accounted  for  people's  judgments. 

In  the  present  study,  responses  to  the  NRTI  by  the  four  job  performers 
contained  evidence  to  suggest  that  people  may  not  respond  to  the  genus  aspect 
of  a species  display  hut,  ratlier,  to  the  content  of  ttie  latter. 

In  addition,  responding  to  Information  displays  with  a simple  "yes, 

I read  things  like  tliat"  or  "No,  I do  noc  read  things  like  tiiat"  does  not 
define  a task,  because  the  term  "read"  Is  not  defined.  However,  since  figures 
and  tables  are  considered  to  be  "read,"  a general  definition  like  "extracting 
information  from  visual  displays"  may  be  necessary.  The  problem  with  this 
definition  is  that  extraction  of  information  can  go  on  at  various  levels. 

For  Instance,  one  can  extract  information  about  the  kind  of  type  (pica?) 
used  and  the  color  of  the  ink — or  one  can  extract  Information  useful  for  con- 
structing ideas  represented  by  the  message  encoded  in  the  printed  display. 

If  the  latter  is  the  goal,  it  is  necessary  to  know  what  type  of  Information 
is  being  sought,  for  what  types  of  ideas,  and  with  what  tvpe  of  given  display. 

For  the  above  reasons,  an  attempt  was  made  to  determine  (1)  what 
kinds  of  generic  displays  (texts,  figures,  etc.)  people  read  and  (2)  whether 
or  not  they  used  these  displays  to  seek  two  generic  types  of  information. 

These  two  types  are  specific  data  for  accomplishing  a task  (fact  finding) 
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and  specific  infi>rmat ion  about  what  to  do  next  (following  directions).  How- 
ever, since  we  have  little  evidence  that  these  various  distinctions  entered 
into  people's  judgments  wlien  completing  the  NRTl  , we  cannot  be  certain  tliat 
the  NRTI  validly  represents  our  conceptual  distinctions — whether  or  not  tlie 
latter  are  useful  ways  of  tliinkfng  about  Job  reading  tasks. 

Finally,  the  question  of  scaling  the  NRTI  items  for  difficulty  imposes 
the  additional  problems  of  liow  to  formulate  fact  finding  and  following  direc- 
tions questions.  Some  of  the  problems  involved  in  this  endeavor  were  discussed 
above.  Suffice  it  to  say  that  a better  conception  of  the  distinction  between 
fact  finding  and  following  directions  question  seems  desirable  to  determine 
whether  or  not  any  major  differences  in  intormation  processing  exist  between 
these  activities,  and,  if  so,  whether  items  can  be  written  to  separately 
evaluate  these  differences.  Beyond  tiiis,  problems  of  drawing  inferences 
about  a generic  type  of  item  from  a specimen  of  that  item  still  remain. 

It  should  be  pointed  out  tliat  tlie  foregoing  problems  are  not  specific 
to  the  determination  of  job  reading  requirements.  Indeed,  they  permeate  all 
aspects  of  job  and  task  analysis  and  all  psychometric  approaclies  to  the  evalua- 
tion of  skills  and  knowledges  in  any  domain  of  activities.  Witiiin  tiiesc 
limits,  it  is  believed  that  the  NRTl/T  procedures  described  herein  can,  with 
further  refinement,  be  usefully  applied  to  the  assessment  of  the  reading 
demands  of  Navy  ratings,  so  that  job-related  reading  curricula  and  objectives 
can  be  more  meaningfully  conceived. 


SURVEY  OF  THE  NAVY'S  TRAINING  SYSTEMS 


To  build  a more  responsive  career  development  system,  it  is  necessary 
to  understand  the  components  o£  the  subsystems  to  be  integrated,  and  to 
identify  any  existing  formal  or  informal  linkages  between  these  subsystems 
that  might  be  used  to  facilitate  the  integration  of  job  skills  and  literacy 
skills  training.  Therefore,  this  section  will  briefly  describe  the  Navy's 
current  Job  Skills  Training,  General  Education,  and  Career  Counseling 
Systems. 

Information  concerning  these  career  development  subsystems  was  obtained 
via  site  visits  to  Navy  Training  Centers,  interviews  with  cognizant  Navy  and 
civilian  training  personnel,  and  review  of  relevant  Navy  and  civilian  lit- 
erature. 

Job  Skills  Training  System 

The  Navy's  Job  Skills  Training  System,  illustrated  on  the  left  side  of 
Figure  5,  is  designed  to  receive  relatively  unskilled  civilian  personnel  and 
to  train  them  to  become  competent  job  performers  within  a short  time  period. 

This  allows  the  Navy  to  maintain  a constant  manpower  level  both  on  shore  and 
in  the  fleet. 

Nature  of  the  Training  and  Its  Components 

Briefly,  Navy  enlisted  personnel  arc  selected  into  the  Navy  based  on 
the  results  of  the  mental  and  physical  examinations  administered  at  the  Armed 
Forces  Entrance  and  Examination  Station  (AFEES) . Upon  induction,  these  per- 
sonnel proceed  through  a series  of  training  programs.  Recruit  Training,  and 
Basic  Technical  (Class  A)  School  or  Apprenticeship  training,  before  being 
assigned  to  their  first  tour  of  sea  duty.  During  their  initial  iob  assign- 
ment, new  personnel  receive  on-the-job  training  under  the  direction  of  their 
work  supervisor,  as  part  of  their  regular  work  assignments.  Alter  an  individual 
has  mastered  the  entry  level  jobs  in  his  rating,  he  is  eligible  for  advanced 
job  training,  generally  provided  as  a reenlistment  incentive  by  the  Navy.  Upon 
completion  of  that  training,  he  is  again  r 'tui  ned  to  the  regular  work  force  and 
continues  in  the  training/work  cycle  until  career  terminat iiui . 

Reading  Uem ands  of  System  Activiti es 

A major  reason  for  studying  the  job  skills  training  system  is  to 
identify  areas  in  which  reading  requirements,  as  imposed  by  some  cari'or 
activity,  might  act  as  a barrier  to  career  advancement.  Thus,  relevant  Navy 
policy  and  training  documents,  describing  both  the  resident  and  nonresident 
training  programs,  as  well  as  any  formal  advancement  retiu i remen t s , were  reviewed. 
Tlie  Nav  •■ ' s Manual  of  Qualifications  for  Advancement  (NAV'PERS  18068)  was  of 
sptu-ial  value  in  this  regard.  This  review  indicated  that,  with  the  except  ion 
of  E-2,  all  rate  advancement  stages  have  substantial  reading  requirements.  In 
fact,  as  soon  as  a person  applies  to  enter  the  Navy,  he  is  faced  with  a verv 
heavy  literacy  skill  requ  i rcmien  t in  tlu'  form  of  th*'  apt  itude  testing,,  which 
occurs  at  the  AFEES.  Since  me'st  aptitude  tests  art'  jiap*' r-and-pem' i 1 tests,  the 
person's  reading,  aiiilily  (literacy  skills)  has  a direct  affect  I'n  his  abilitv 
to  demonstrate  liis  true  aptitude.  His  peric'rmance  on  these  tests  has  a l.isting 
im[)ortance,  in  that  th(>  scores  obtained  .are  us(ul  to  determine  h i init  i.il  career 
and  job  training  assignment,  as  well  as  his  future  career  .iml  training  assign- 
ment s . 
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Resident  TrainiiiR  Activities.  In  his  first  formal  Navy  assignment. 
Recruit  Training  (RT),  tlie  new  recruit  again  faces  a literacy  skills  require- 
ment in  the  dual  form  of  taking  lecture  notes  and  studying  (reading)  them, 
and  studying  the  Basic  Military  Requirements  Manual  and  Bluejackets'  Manual 
in  preparation  for  taking  the  four  paper-and-penc il  multiple-choice  tests 
administered  in  RT.  In  order  to  successfully  complete  RT,  he  must  meet  a 
specified  percent  correct  standard  on  each  test.  Sticht  et  al.  (1977)  found 
that  3b  percent  of  the  Job  performers  and  5 percent  of  the  students  reported 
experiencing  some  reading  problems  in  RT.  Since  the  job  performers  are 
recalling  their  RT  experiences,  while  the  students  are  reporting  immediate 
RT  experience,  the  students'  judgment  should  probably  be  considered  as  more 
valid;  hence,  it  would  seem  that  the  reading  demands  are  not  jiar ticularly 
heavy  for  this  career  activity. 

Despite  the  fact  that  only  5 percent  of  the  students  reported 
experiencing  reading  problems  in  RT,  this  is  the  only  point  in  the  training 
pipeline  where  literacy  training  is  formally  required  for  Navy  personnel. 

Thus,  it  would  seem  that  either  the  literacy  load  in  RT  is  perceived  as  being 
substantial,  or  tliat  this  literacy  training  is  perceived  as  preparation  not 
only  for  RT,  but  for  the  next  phase  in  tlie  recruit's  training.  The  latter 
may  be  the  case,  since  neither  the  recruit  nor  tlie  students  in  Class  A or 
Apprenticeship  schools  liave  any  other  opportunity  to  acquire  literacy  training. 

Upon  successful  completion  of  RT,  tlie  recruit  is  assigned  to  either 
A school,  initial  job  skills  training,  or  to  apprenticeship  training  in  one 
of  four  rates:  Airman,  Const ruct ionman , Kireman,  or  Seaman.  In  any  case, 

the  student  is  again  faced  with  the  need  to  use  his  literacy  skills  to  success- 
fully complete  this  stage  of  his  formal  training.  From  observation  of  the 
Seaman  apprenticeship  school  and  specified  A schools,  the  research  st.iff 
observed  that  both  types  of  schools  tended  to  rely  heavily  on  the  lecture/note- 
taking/ text-read  i ng/wr  i t Len-test-taking  procedures  of  training.  It  was  also 
observed  that  the  materials  and  academic  load  is  heavier  in  the  A schools  than 
in  the  apprenticeship  schools.  This  observation  is  supported  by  the  Navy's 
policy  of  generally  sending  only  its  more  qualified,  better  aptitude  personnel 
to  the  A sctiools,  with  the  npprent  icesli  ip  schools  usually  receiving  the  other 
personnel.  In  any  case,  the  training  at  this  stage  of  a person's  career  relies 
heavily  upon  the  person's  ability  to  obtain  and  demonstrate  his  attainment  ol 
knowledge  tiirough  the  use  of  his  literacy  skills.  Tiiis  conclusion  is  reinforcei 
by  tlie  fact  tliat  some  56  percent  of  tlie  students  interviewi'd  by  Sticht  et  al. 
(1977)  reported  liaving  some  problems  understanding  (reading)  the  materials 
used  in  Class  A scliool  programs.  Overall,  36  jicrcent  of  all  the  personnel 
Interviewed  reported  reading  problems  with  the  A school  training. 

Nonresident  i'rainirig  Activities.  Once  an  enlisted  man  is  permanentlv 
assigned  to  a duty  station,  the  next  major  literacy  skill  requirement,  in 
refereiiie  to  formal  career  advanci’ment  reci.  ' reini'ii  t s , occurs  either  when  lie 
begins  to  prc|>are  for  advani-enient  to  tile  next  rate  level,  or  wlu'n  he  is  sent 
for  advanced  training,  at  .i  Class  C school.  The  latter  literaev  load  is 
probably  very  similar  to  that  described  above  for  the  Class  A schools  in 
most  cases.  In  reference  to  rate  advancement  s , tlii'ie  is  no  li'rmal  literacy 
skill  barrier  for  advancement  to  F,-d.  For  advancenusit  to  F.-3,  A school  grad- 
uates must  complete  the  Basic  Military  Requirement  (BMF)  corr espondence 


course  (i.e.,  read  the  text  and  answer  the  multiple-choice  questions  provided 
with  the  text).  Students  are  required  to  meet  a modest  standard  of  number 
of  correctly  answered  questions  per  section  before  being  officially  certified 
as  having  successfully  completed  the  course.  Apprenticeship  graduates  must 
take  the  same  course  under  the  same  conditions,  in  addition  to  taking  the 
correspondence  course  for  their  rate  (i.e..  Seaman,  Fireman,  Constructionman, 
or  Airman).  This  course  operates  under  the  same  guidance  and  standards  as 
the  BMR  correspondence  course.  However,  these  students  must  take  a written 
end-of-course  test,  either  a locally  constructed  one  or  one  available  from 
the  correspondence  course  center,  in  order  to  be  officially  certified  as  having 
successfully  completed  the  course. 

There  are  two  major  mandatory  correspondence  course  requirements 
(literacy  requirements)  imposed  on  all  Navy  personnel  for  preparation  for 
advancement  to  Petty  Officer  3rd  Class  (E-4)  and  2nd  Class  (F-5) : 

1.  Military  Requirements  Correspondence  Course  (CC)  for  P03  and  P02. 

2.  Rating  specific  3 and  2 correspondence  courses. 

Both  courses  are  composed  of  a rate  training  manual  and  a series  of 
multiple-choice  questions  and  follow  the  same  administrative  procedures 
described  for  the  BMR  CC.  There  is  a separate  Military  Requirements  CC  for 
personnel  advancing  to  E-4  and  to  E-5.  However,  the  rating  CC  is  a combined 
course  for  PO  3rd  and  2nd  Class,  which  is  required  to  be  formally  completed 
only  once.  Apprenticeship  graduates  are  required  to  take  their  specific  rating 
P03  and  2 CC  in  order  to  be  eligible  for  advancement  to  E-4,  while  A scliool 
graduates  are  not  required  to  take  their  specific  rating  CC  until  they  are 
ready  for  advancement  to  E-5.  After  completing  the  t;C  requirements  for  advance 
ment,  all  personnel  must  take  a Navy-wide  Military  Leadersliip  Exam  and  a Navy- 
wide exam  in  their  specific  rating  for  promotion  to  E-4  (P03)  and  for  pro- 
motion to  E-5  (P02) . Both  of  these  exams  are  paper-and-penc  i 1 tests. 

For  promotion  to  E-6  and  E-7 , the  mandatory  requirement  consists  of  the 
POl  and  Chief  CC,  wlilch  need  be  taken  only  for  the  E-6  promotion,  and  tlie  Navy- 
wide exam  in  the  specific  rating  for  E-6  and  for  E-7.  Tlius,  tlie  reading  demand 
imposed  by  correspondence  courses  seem  to  be  rather  heavy;  in  this  regard,  over 
a third  of  tfie  personnel  interviewed  reported  liaving  difficulty  understanding 
the  CC  materials.  In  fact,  73  percent  of  tlie  Instructors  (N  = 11)  indicated 
that  they  had  difficulty  with  their  CCs. 

General  Education  Training  System 

Paralleling  the  job  skills  training  system  is  the  Navv's  General 
Educational  Development  (GED)  system,  which  is  designed  to  provide  Navy 
personnel  with  opportunities  for  personal  growth  and  development  in  tlie 
areas  of  general  education  knowledgi'S  and  skills.  For  present  purposes, 
wo  may  consider  tills  system  to  be  composed  of  two  major  components:  (1) 

in-lunise  literacy  training  programs  (on-duty)  and  (2)  off-duty  general 
education  programs.  Tlie  latter  is  subdivided  into  two  branches:  (1)  tlie 

Navy  Campus  for  Achievement  (NCFA)  and  (2)  the  Defense  Activity  for  Non- 
Traditional  Educational  Support  (DANTES).  Belore  discussing  tlie  current 


linkages  between  the  GEO  system  and  the  job  skills  training  system,  a brief 
description  of  the  components  of  the  GED  system  will  be  presented  (see 
Figure  5). 

In-House  Literacy  TraininK 

One  aspect  of  the  Navy's  GED  system  is  the  on-duty  remedial  reading 
training  provided  for  selected  Navy  recruits  during  the  early  weeks  of 
Recruit  Training — the  Academic  Remedial  Training  (ART).  This  training, 
given  at  the  Navy's  three  recruit  training  centers  at  Great  Lakes,  San  Diego, 
and  Orlando  consists  of  short-term  (maximum  length  is  8 weeks)  training  pro- 
grams provided  to  assist  marginally  skilled  personnel  in  coping  with  the 
minimum  reading  demands  of  Recruit  Training.  ART,  the  first  general  educa- 
tion training  offered  to  Navy  recruits,  is  provided  by  removing  from  RT  those 
students  identified  as  liaving  marginal  reading  skills;  i.e.,  reading  below 
the  5.0  reading  grade  level.  These  selected  students  are  sent  to  a short 
remedial  reading  program  at  the  Recruit  Training  Center,  upon  completion  of 
whicli  they  are  returned  to  Recruit  Training.  Depending  on  tlie  local  AI!'I 
regulations,  nonsuccessful  ART  students  can  be  recommended  for  discharge  from 
the  Navy. 

Off-Duty  Education 

The  Navy's  off-duty  education  system  is  the  Navy  Campus  for  Achieve- 
ment (NCFA)  program.  The  NCFA,  officially  described  by  CNETINST  1560.3, 
(1975),  is  "the  management  system  that  coordinates  all  voluntary  off-duty 
educational  experiences  and  integrates  them  with  on-duty  programs  . . . [so 
as  to]  contribute  to  the  general  academic  and  vocational  development  of  all 
naval  personnel"  (p.  I-l). 

NFCA  Obiective.  The  formal  objectives  of  the  NCFA  program  are: 

1.  "To  provide  naval  personnel  with  voluntary  off-duty 
educational  opportunities  for  career  long-range  needs  of 
Navy,  the  nation,  and  themselves. 

2.  "To  provide  for  the  establishment  of  on-site  off-duty 
educational  services  programs  at  every  naval  activity 
(asliore  and  afloat)  encompassing  a broad  range  of 
educational  experiences  including  basic  and  remedial 
education;  high  school  equivalency  and/or  high  school 
diploma  programs;  associate,  baccalaureate,  and  advanced 
degn-e  programs;  and  vocational  and  technical  programs. 

3.  "lo  maintain  a ni'twork  of  professional  educational 
advisors  who  provide  unit  commanders  with  technical 
guidance  concerning  educational  programs  and  Navy 
personnel  with  i-ducational  and  vocational  counseling. 

4.  "To  provide  for  the  elimination  of  obstacles  n.av.al  per- 
sonnel face  in  the  attainment  of  educational  goals 


sui  h as  n-sldi'iuy  r cqu  1 ri’iiuail  s , nun-t  ransItTiib  i 1 1 1 y 
<>r  rredii,  noii-r  t-aogii  1 1 i on  of  Navy  on-cluly  edu<at  Ion 
and  training  hy  civilian  institutions,  and  reluctance 
by  trade  organizations  to  validate  Navy  job  experiences." 


NCFA  Programs.  The  six  basic 
listed  below: 

Program  Name 

NCFA  Degree  Program 

Instructor  Hire  Program 

Tuition  Assistance  Program 

Program  for 
Afloat  College  Education  (PACE) 

Veterans  Administration  Educa- 
tional Assistance  (Cl  Bill) 

Veterans  Administration  Educa- 
tional Assistance — Predischarge 
Education  Program  (PREP) 

DANTES  Program  and  Objectives, 
program  which  has  two  major  objectives: 


(CNETINST  1560.  j,  1P75,  pp  1-2  {.  1-3) 
programs  included  in  tlie  NCFA  are 

Basic  Purpose 

Provide  Post  Secondary  Educa- 
f tional  Opportunities. 


Provide  basic  skill  upgrade 
L training  to  permit  student  to 
I obtain  GED  or  high  school  diploma. 

NCFA  also  coordinates  the  DANTES 


1.  "To  provide  cr ed i t-by-examinat ion  programs  for  military 
personnel  through  the  Services  voluntary  education 
programs,  and 

2.  "to  prepare  and  distribute  a catalog  of  independent 
study  programs  and  courses  available  to  servicemen 
and  women." 


This  program  is  just  getting  started,  but  it  too  is  geared  towards  providing 
post  secondary  assistance  to  Navy  personnel.  Thus,  the  major  thrust  for  the 
Navy's  General  Education  Development  system  is  at  the  post  secondary  level, 
with  only  minor  concern  being  given  to  programs  like  PREP  and  ART,  which  are 
concerned  with  assisting  marginally  skilled  or  educated  personnel. 

Linkages  Between  .lob  Skills  Training  and  GED 

Forma!  (Policy)  Llnkagi:s 

Currently,  two  linkages  exist  between  the  job  skills  training  and  GED 
systems  in  the  form  of  official  Navy  literature.  One  of  these  linkages  is 
between  RT  and  the  acaiiemic  remedial  (reading)  training  (ART)  mentioned 
above.  According  to  BUPERS,  all  personnel  identified  bv  RT  instructional 
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or  administrative  personnel  as  having  "severe,  genuine  difficulty  with  the 
mastery  of  presented  subject  matter  because  of  literacv  problems,  . . . will 

be  considered  a candidate  for  remedial  literacy  training"  (Bl’PERS  letter 
13  Sep  67,  Per S-C21 la-dor , Ser :C21/209) . Formally  stated,  the  objective  of 
ART  Is  to  help  recruits  raise  their  reading  ability  to  a reading  grade  level 
of  approximately  5.0,  as  soon  as  possible. 

Another  formal  linkage  is  mandated  by  NCFA  policy,  which  requires 
that  personnel  receive  educational  counseling  within  30  days  of  arrival  at 
a new  duty  station.  However,  during  conversations  with  NCFA  staff,  it  was 
indicated  that  current  NCFA  staffing  (including  Education  Service  Officers') 
does  not  permit  close  adherence  to  this  policy.  Other  than  the  NCFA  policy 
and  the  RT/ART  linkage,  there  seems  to  be  no  other  formal  Navy  policy-imposed 
linkages  between  the  job  skills  training  and  the  GED  systems. 

This  same  relationship  was  examined  in  both  the  Army  and  Air  Force 
systems  to  see  if  those  services  operate  differently  than  the  Navy.  It  was 
found  that  this  same  limited  formal  relationship  also  exists  in  the  Army, 
where  the  only  policy  linkage  is  between  tlie  Army's  entry  level  job  skills 
training  program  and  its  literacy  training  program.  The  Army's  Advanced 
Individual  Training  Preparatory  Training  (AITPT),  Training  and  Doctrine 
Command  Circular  621-1,  requires  tli.  t all  Mental  Category  III  and  IV  person- 
nel with  certain  job  assignments,  wtio  read  below  the  6.2  grade  level,  are  to 
be  given  remedial  reading  training.  The  regulation  also  permits  other  per- 
sonnel in  trainee  status  to  be  assigned  to  the  AITPT  program  on  a space  avail- 
able basis.  This  training,  with  a maximum  length  of  6 weeks,  is  given  just 
prior  to  job  training  so  as  to  prepare  marginally  literate  personnel  to  cope 
witli  the  reading  demands  inherent  in  the  job  skills  training.  The  program's 
objective  is  the  attainment  of  a minimum  7.0  reading  grade  level  in  job- 
related  reading. 


In  contrast  to  both  the  Army  and  the  Navy,  tiie  Air  Force  has  estab- 
lished two  policy  linkages  between  tiieir  job  skills  training  and  tlieir  GF.D 
training  systems.  The  first,  equivalent  to  the  Navy's  RT/ART,  and  to  tlie 
Army's  Job  Tra ining/AITPT  linkages,  is  the  Air  Force  regulation  requiring 
all  newly  inducted  Mental  Category  IV  personnel  reading  below  ti.O  to  lie  given 
remedial  reading  training.  The  program,  of  13  weeks  maximum  length,  is  given 
prior  to  basic  military  training  and  has  the  objective  of  having  personnel 
attain  a 6.0  reading  grade  level.  Tin'  second  formal  linkagi',  created  bv  Air 
Force  Manual  50-23,  is  between-job  skills  upgrade  training,  given  after  an 
airman  has  been  assigned  to  a permanent  duty  station,  and  remi-dial  reading 
training.  The  regulation  requires  that  all  personnel  with  an  Airman  fjualily- 
ing  Examination  score  or  Airman  Classif icat ion  Battery  general  score  oi  50 
or  less,  and  who  score  below  the  9.0  reading  grade  level  on  a sl.uidai  ai  i ced 
reading  test,  be  enrolled  in  a reading  improvement  course  concurrent  with 
job  skills  upgrade  training.  (The  latter  is  a correspondence  course  designed 
to  prepare  airmen  for  the  next  higher  level  of  job  skills  and  duties.)  the 
regulation  also  permits  other  personnel,  iilentified  as  having  reading  prob- 
lems on  the  job,  or  in  the  upgrade  training,  to  bk'  assigned  to  t lu'  re.uling 
training  program.  The  objektive  of  the  readiiig  irainirtg  is  the  achievement 
of  a 9.0  reading  grakie  levi'l.  Thus,  t lu'  Air  Fkirck^  is  the  I'lilv  oiik'  k't  t lu’ 


tlireo  services  that  formally  (i.e.,  tlirough  written  regulations)  provides 
a linkage  between  the  job  skills  training  and  GKD  systems  beyond  the  entry 
stages  of  a person's  military  career. 

Informal  (Content)  Llnktiges 

In  addition  to  policy-based  linkages,  there  is  a question  as  to  what 
extent  content  linloiges  exist  between  the  job  skills  training  and  the  GED 
training  systems.  That  is,  does  the  content  of  the  various  GET)  programs 
supplement,  enhance,  or  otherwise  directly  relate  to  facilitating  the  Navy's 
job  skills  training  programs?  Examination  of  descriptive  materials  from 
DANTES  and  literature  regarding  the  NCEA  indicate  that  the  GED  and  job  skills 
training  systems  exist  as  separate  and  distinct  entities  with  little  or  no 
attempt  to  interrelate  their  training  objectives  or  their  content.  Basically, 
the  Navy's  job  skills  training  has  been  designed  to  provide  personnel  with 
rating-specific  information  and  skills,  while  the  GED  programs  were  set  up 
to  focus  on  improving  and  broadening  one's  general  cognitive  and  affective 
skills  and  knowledges.  Perhaps  there  are  .-wTme  indi,rect  benefits  afforded 
one  system  as  a result  of  training  in  the, other j but  '«he  benefits  are  not  as 
directly  applicable  nor  noticeable,  as  should  be  the)  case,  if  the  two  ti lin- 
ing systems  had  been  purposely  designed  to  in'^>ract ' and  reinforce  the  train- 
ing in  each  other.  Even  in  the  ART  program, ywhich  has  a policy  link  to  the 
skills  training  system,  the  content  has  not,  with  some  small  exception,  been 
designed  to  complement,  reinforce,  or  even  relate  to,  the  content  encountered 
in  Recruit  Training.  This  is  particularly  Inappropriate,  since  tiie  purpose 
of  the  ART  training  is  to  assist  marginally  skilled  personnel  in  successfully 
completing  RT. 

The  content  of  the  ART  program  at  all  three  locations  is  of  a general 
educational  nature,  in  which  commercially  available,  and  locally  developed, 
beginning  reading  and  public  school  remedial  reading  training  materials  are 
used.  Some  of  the  programs  have  interspersed  Navy  terms  and  vocabulary  words 
in  tlieir  general  materials,  and  have  provided  some  minimal  training  in  RT 
basic  subjects.  However,  aside  from  these  similarities,  there  is  considerable 
difference  between  the  three  programs,  including  terminal  objectives,  assess- 
ment instruments,  emphasis  in  course  content,  program  length,  instructor 
philosophies,  and  program  resources.  So,  while  there  is  a formal  regulation 
requiring  tlie  conduct  of  ART  for  specified  personnel,  there  is  only  minimal 
regulation  on  the  conduct /content  of  tlie  training.  The  latter  has  been  loft 
to  the  discretion  of  local  commands,  thus  permitting  wide  variability  in  the 
three  programs. 

In  examining  the  Army  and  the  Air  Force  systems  in  relation  to  content 
linkages,  it  w.is  found  that  wlille  the  Air  Force  and  Navy  programs  are  similar, 
the  Army's  program  is  completely  different,  both  in  its  materials  and  basic 
philosophy.  The  Army's  AITPT  program  is  a job-related  reading  program  utiliz- 
ing the  materials  which  tiie  student  is  expected  to  use  both  in  his  job  skills 
training  program  and  out  on  the  job  itself.  Tlie  training  is,  however,  pre- 
sented In  isolation  of  the  actual  job  skills  training  as  a prerequisite  train- 
ing program  which  people  must  complete  prior  to  going  into  tlieir  job  skills 
training. 
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Career  C.ounsellng  System 


Currently,  tlie  Navy's  Career  Counseling  System  has  a two-fold  purpose: 
(1)  to  maintain  an  adequate  force  of  qualified  active-duty  personnel  and  (2) 
to  provide  career  development  information  and  guidance  to  meet  the  individual 
needs  of  all  enlisted  Navy  personnel  (Meshi,  Holoter,  Dow,  & Crace,  1972,  p.  1). 
The  system  is  staffed  with  three  levels  of  counselors:  full-time  career 

counselors  at  the  command  level  and  part-time  counselors  at  the  department 
and  division  levels.  Througii  the  use  of  personnel  interviews,  content  area 
experts,  and  other  personal  interactions,  career  counselors  try  to  facilitate 
the  dissemination  of  information  to  enlisted  personnel  in  the  context  of  three 
basic  career  phases  (Meshi  et  al.,  1972):  (1)  Preassignment  Contacts,  (2) 

In-Service  Counseling  Actions,  and  (3)  Post-Separ t ion  Alternatives. 

Phase  1 activities  parallel  the  AFEES  and_  Recruit  Training  activities 
of  the  Job  Skills  Training  System.  The  purposes  of  this  phase,  conducted 
mainly  by  the  recruiter  with  assistance  from  administrative  personnel,  are 
(1)  to  acquaint  civilian  personnel  with  the  various  opportunities  available 
to  people  through  a career  in  the  Navy,  (2)  to  assess  the  skills  and  abilities 
of  potential  recruits,  and  (3)  to  initiate  the  recruit's  Navy  career  by  assign- 
ment to  an  entry-level  job  skills  training  program. 

Phase  2 is  divided  into  three  basic  types  of  activities:  Career- 

Related,  Preseparation-Related,  and  Reenlistment-Related  Inverviews,  whicli 
parallel  the  various  career/training  activities  enlisted  personnel  encounter 
after  completion  of  Recruit  Training.  The  Career-Related  Interviews  are  con- 
ducted by  various  administrative,  command,  and  advisory  personnel  to  help 
enlisted  personnel  keep  abreast  of  occupational  and  educational  opportunities, 
changes  in  work  assignment  and  command  mission,  progress  in  rating,  require- 
ments for  advancement,  and  other  benefits  and  considerations  relevant  to  the 
person,  his  family,  or  the. Navy.  The  Preseparation-Related  Interviews  are 
conducted  to  assist  the  enlisted  personnel  in  deciding  about  a Navy  or  civilian 
career  by  discussing  the  opportunities  and  advantages  available  in  lioth  areas. 

In  the  event  c'f  his  reenlistment,  a series  of  congratulatory  interviews  are 
conducted  and  the  person  moves  back  into  the  Career  Interview  suhphase  of  the 
Tn-Service  Counseling  Phase.  These  three  subphases  operate  in  this  cyclical 
fashion  until  Phase  3 occurs. 

Phase  3 is  designed  to  assist  Navy  personnel  who  are  eitlier  retiring 
or  separating  from  the  Navy  by  acquainting  them  with  the  various  benefits  and 
opportunities  available  to  them  as  a civilian  because  of  their  service  with 
the  Navy. 

At  all  times,  retirees  and  active  duty  personnel  are  eligible  for 
special  (uuinsellng  services,  which  are  provided  in  four  broad  areas:  transter, 

new  assignment,  details  concerning  other  Navy  related  assistance,  and 
personal  services.  Included  in  the  personal  category  are:  legal  assis- 

tance, religious  counseling,  marriage,  alcoliol  or  drug  problems,  minoritv 
group  assistance,  medical  assistance,  and  education  assistance.  Tlu>se 
special  .‘ounseling  sessions  are  comlucted  by  area  i-xperts  provided  by 
tiie  career  counselors.  For  instance,  personni'l  needing  or  desiring  i>duca- 
tional  counseling  are  ri'ferred  by  the  career  tounselor  to  the  ship  or 
station's  Eaiucational  Services  Officer  (ESO)  or  the  NTFA  ('ounselor. 


Formal  Linkages  of  Counsel ing  Pro>;ram  With  GED  and  Job  Skills  Training 


As  indicated  above,  there  is  frequent  interactioii  between  Pliases  1 and 
2 of  the  counseling  system  and  the  various  components  of  the  job  skills 
system.  Many  of  these  linkages  are  formal  in  nature;  that  is,  they  are  man- 
dated by  Navy  regulation  or  policy  such  as  the  annual  personal  career  pro- 
gress interview,  formal  brief ini,s  of  group  or  Individuals  re  new  policies/ 
programs/car eer  opportunities,  and  the  periodic  review/update  of  personnel 
records  with  tlie  individual.  Other  linkages  are  less  formal  in  that  tlie 
interaction  is  initiated  by  the  enlisted  person  himself  through  a request 
for  special  counseling  or  seme  career  or  reenlistment  information.  In  com- 
parison, there  is  little  formal  linkage  between  the  counseling  and  the  GED 
systems  except  that  which  occurs  when  an  enlisted  person  is  referred  by  the 
career  counselor  to  an  ESO  or  Nt'FA  counselor  for  educational  assistance 
Otherwise,  interaction  of  both  the  career  counseling  and  the  job  skills 
systems  with  the  GED  system  seems  to  occur  most  frequently  on  a voluntary, 
self  Initiated,  iwlk-in  basis. 

The  current  linkages  between  the  job  skills  and  counseling  system  appear 
to  be  facilitated  by  the  fact  that  various  administrative  personnel  perform 
dual  roles  and,  thus,  link  the  two  systems.  For  instance,  Personnelmen  are 
<jn  integral  part  of  tlie  administrative  network  of  any  Navy  activity,  and  they 
are  also  utilized  by  the  counseling  system  to  conduct  some  of  the  interviewing 
an<i  counseling  activities.  For  die  GED  and  counseling  systems,  the  only  exampl 
of  a linkage  based  on  multiple  roles  is  the  Educational  Services  Officer,  who 
represents  the  GED  system  and  is  also  utilized  as  a content  expert  by  the 
counseling  system.  Because  the  ESO  also  has  responsibility  for  obtaining,  dis- 
tributing, and  monitoring  the  Rate  Training  Correspondence  Courses,  he  forms  a 
three-way  link  among  the  job  skills  training,  GED,  and  counseling  systems. 
Generally,  it  appears  that  the  career  development  system  could  be  used  more 
advantageously  in  the  operation  of  an  integrated  job  skill s/readiag  skills 
training  system. 

One  obvious  area  of  contribution  is  in  the  counseling  of  personnel  about 
the  need  for  reading  training  for  career  development,  and  the  explanation  of 
how  to  obtain  such  training  in  the  Navy's  education  system.  A second,  perhaps 
not  so  obvious,  area  in  which  thi'  counseling  system  could  help  is  In  providing 
closer  linkage  to  psyclio  log  tea  1 , legal,  and  what  might  bi>  called  "life  problem 
solving"  services  for  marginally  literate  personnel  who  arc  more  likely  to  need 
such  services  than  more  highly  con.petent  personnel  (Hoiberg,  Hysham,  N Berrv, 
1974). 
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The  transformation  from  a career  development  system  that  treats  job 
skills  and  reading  training  as  unrelated  programs  and  that  tearties  com- 
pletely different  knowledges  and  skills,  to  one  In  which  job  skills  and 
reading  skills  are  developed  in  an  integrated  manner  can  proceed  in  an 
evolutionary  manner.  Karly  changes  should  build  on  what  already  e.xlsts 
by  tightening  the  policy  linkages  among  the  job  skills  training,  career 

counseling,  and  General  Educational  Development  (GED)  components  of  the  J 

career  development  system,  and  by  developing  content  linkages  among  the  iob  j 

skills  and  GED  systems.  An  integrated  job  skills  and  GED  system  should  be 
developed  througii  RfiD  tluit  begins  with  development  of  job-related  training 
programs  to  prepare  trainees  for  reading  tasks  in  A school,  in  recruit  train- 
ing, and  on  the  job  at  duty  stations. 

Initial  Changes  to  Existing  System 

Clianges  in  Pol  icy  Linkages 

Policy  linkages  can  be  tightened  by  requiring  reading  achievement 
testing  at  all  Recruit  Training  Genters  rather  than  permitting  each  RTC 
to  formulate  and  conduct  its  own  policy  and  methods  for  determining  Individual 
reading  training  needs.  Mandatory  testing  of  all  recruits  in  mental  categories 
111  and  IV  might  be  initiated  at  all  three  RTCs  using  the  same  test.  Ideally, 
this  test  would  be  similar  to  the  NRTT  in  that  it  would  test  the  resiHindent ' s 
ability  to  perform  reading  tasks  encountered  in  Navy  training  programs.  How- 
ever, even  a standardized  test,  consistently  applied  across  the  three  RTCs, 
could  assure  r.  more  uniform  basis  for  assignment  to  reading  training  than  cur- 
rently exists. 

Policy  linkage  can  also  be  tightened  for  A school  training  and  on-the- 
job  training  by  the  specification  of  mandatory  levels  of  achievement.  Again, 
achievement  should  be  specified  in  terms  of  tlu  performance  on  tasks  using 
job  reading  nwiterials,  and  calling  for  the  types  of  information  processing 
useful  for  performing  Navy  reading  tasks.  Although  the  precise  spec i f icat ion 
of  such  tasks  would  require  considerable  research,  it  is  possible  to  proceed 
on  the  basis  of  the  best  state-of-the-art  information  and  to  introduce  revi- 
sions as  research  developments  permit. 

Gareer  counselling  policie’s  can  be  modified  to  require  education  ofticers 
to  provide  information  about  the  reading,  eienwinds  of  Navy  ratings  based  uj>on 
the  discussion  in  this  report  and  in  otlu-r  documents  that  discuss  reading, 
problems  and  training,  witliin  the  armed  services  in  general  (Sticht  N Kapt  , 

1V76;  Sticht,  1975a,  b)  attd  the  Navy  in  particular  (Duffy  i-t  al.,  l'>75).  This 
might  be  facilitated  by  the  development  of  a succinct  pamphlet  containing  per- 
tinent information  that  educat  ion  counselors  could  use. 
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Career  counseling  regarding  the  literacy  demands  of  Navy  ratings 
should  begin  early,  during  the  preinduction  phase,  with  repeated  discus- 
sions of  the  role  of  reading  in  overcoming  the  various  barriers  to  career 
advancement  discussed  earlier.  This  type  of  counseling  should  be  included 
in  the  ART  as  a means  of  helping  the  person  of  very  low  literacy  skills  to 
understand  the  need  for  and  relevance  of  reading  skills  and  other  informa- 
tion processing  capabilities  that  lead  to  a more  adaptable  person  capable 
of  meeting  the  Navy's  job  performance  and  advancement  requirements. 

Additionally,  job  supervisors  can  be  directed  to  recommend  persons 
suspected  of  having  reading  problems  to  contact  the  education  counselor. 

Of  course,  unless  there  J_s  a literacy  training  program  that  produces  results 
which  supervisors  can  detect  and  appreciate,  this  type  of  job  skills/reading 
skills  linkage  will  not  be  sustained.  This  is  another  reason  for  developing 
ri’ading  programs  with  direct  job  relevance. 

Changes  in  Content  Linkages 

The  improvement  of  relationships  among  job  skills  training  and  reading 
training  by  policy  changes  is  a relatively  simple  matter.  It  mostly  requires 
making  decisions  and  then  converting  these  decisions  into  regulatory  directives. 
The  development  of  content  linkages  among  job  skills  and  GED  systems  is  more 
complicated.  Beginning  with  tlie  current  system,  the  content  linkage  between 
Academic  Remedial  Training  (ART)  and  Recruit  Training  (RT)  can  be  tightened 
by  the  provision  of  a policy  directive  that  all  three  ARTs  will  immediately 
provide  at  least  1 hour  of  practice  per  day  in  reading  the  Blue  Jackets' 

Manual  and  the  Basic  Military  Requirements  Manual.  Wliile  leaving  open  tlie 
exact  nature  of  tlie  reading  training  and,  hence,  still  permitting  a diversity 
of  practices  and  a range  of  effectiveness,  such  a directive  would  at  least 
ensure  some  common  element  of  reading  training  focused  on  job  skills  training. 

The  problem  of  changing  the  content  of  reading  training  programs  for 
duty  station  personnel  is  even  more  formidable  because  there  is  no  existing, 
systematic  reading  training  program  offered  for  them.  Instead,  a reading 
course  may  be  offered  on  an  as-needed  basis  at  a given  naval  base  or  aboard 
sliip.  Sometimes,  Navy  personnel  attend  civilian  institutions  such  as  a 
local  community  college  with  a PREP  program.  It  is  probably  unrealistic  to 
require  these  civilian  programs  to  develop  Navy  job-oriented  rending  materials 
within  their  own  budgets  and  time  constraints,  so  a Navy-sponsored  development 
effort  will  more  than  likely  be  necessary.  In  fact,  a similar  effort  is  cur- 
rently underway  In  the  Air  Force  (Huff,  Sticht,  h Joyner,  1976). 

R&l)  Toward  an  Integrated  System 

The  changes  in  policy  and  content  linkages  between  the  j('b  skills  training 
and  GF.IJ  components  of  the  Navy's  career  development  system  require  very  little 
research  and  development.  However,  they  fall  far  short  of  producing  an  effective. 
Integrated  job  skills  training  and  GEO  system.  For  Instance,  simply  requiring 
ARTS  to  have  students  read  the  RT  manuals  for  an  hour  .a  day  does  not  provide 
for  tlie  syst  cm.it  ic  acquisit  ion  of  a unifi'tm  set  of  skills  .and  knowledges.  This 
requires  .1  carefully  developed  prog.ram  of  job-rel.iled  reading  t.asks  with  form.i- 
tive  and  summ.it  ivi‘  evalu.it  ion  instruments  for  prescribing  instruction  .ind  lor 
qua  1 i t y cont  ro I . 
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The  required  approach  is  to  develop  an  integrated  job  skills  training 
and  GED  system  tfirough  R&D  that  begins  with  the  development  of  a job-related 
reading  program  to  prepare  trainees  for  reading  tasks  found  in  A school. 

This  fixed  duration  program  is  to  be  offered  in  a conventional  classroom  just 
prior  to  A school.  It  is  aimed  at  providing  reading  training  in  one  of  the 
three  career  cluster  areas — service/maintenance,  technical /maintenance , and 
data — because  there  are  too  many  different  ratings  to  attempt  to  build  a 
separate  reading  program  for  each  one. 

Following  the  development  of  job-oriented  reading  programs  for  the  tliree 
career  clusters  of  A scliool  preparatory  training  (ASPT),  similar  procedures 
could  be  followed  to  develop  job-related  reading  programs  to  prepare  people 
for  RT  (using  the  current  Academic  Remedial  Training  program)  and  to  provide 
job-oriented  reading  training  for  duty  station  personnel.  (Because  of  the 
similarity  of  the  RT  and  ASPT  programs,  the  development  of  an  RT  job  reading 
program  will  not  be  discussed.) 

Following  the  development  of  the  three  job  reading  programs,  a second 
phase  of  R&D  activities  can  be  undertaken  to  integrate  the  ASPT  program  into 
the  regular  A school  program  witli  tlie  goal  of  reducing,  as  much  as  possible, 
the  front-loaded,  fixed-duration  job  reading  program.  Ttiis  will  lequire 
system  engineering  of  A schools  to  reduce  "nice-to-know"  information  and 
retain  only  training  tltat  is  needed  for  entry  into  job  duty.  Additionally, 
tlie  A school  training  should  permit  self-pacing  of  instruction  to  reduce 
the  training  hours  spent  by  personnel  to  complete  the  course.  Because  systems 
engineering  of  a training  program  requires  a lot  of  time,  money,  and  manpower, 
it  is  expected  that  tliis  revision  would  occur  as  part  of  tlie  Navy's  regular 
updating  of  training  programs.  This  would  constitute  a long-term,  gradual 
modification  of  the  Navy's  training  system. 

During  the  design  of  the  self-paced  A school  training,  the  front-lt'adeil 
job  reading  program  should  be  modified  so  that  reading  training  is  available 
during  the  regular  job  skills  training  day  and  is  closely  articulated,  in 
sequence  and  scope,  to  the  job  skills  training. 

Following  this  second  phase  of  activities,  which  should  probably  he 
extended  only  to  A schools  at  whicli  reading  is  a major  problem,  a similar 
integration  can  be  accomplished  for  RT.  For  duty  station  training,  a maiot 
effort  would  be  to  integrate  the  job  reading  skills  training  into  Rate  Train- 
ing Correspondence  Courses  that  have  been  thoroughly  system  engineered  to 
train  only  those  aspects  of  Navy  job  skills  and  knowledges  that  are  not  better 
learned  tlirough  OJT. 

Thus,  the  major  steps  envisic)ned  for  an  R&l)  program  to  develop  an  integrated 
job  skills  and  reading  skills  training  system  Included  thi'  following: 

1.  Develop  a front-loaded,  fixed-duration  A school  preparati'ry  training 
(ASPT)  program  for  each  of  the  three  career  cluster  areas. 

2.  Develop  a job-related  academic  remedial  training  (.lART)  prc'g.rara  of  a 
f ront- 1 oaded  , f ixt'd-durat  ion  nature  for  recruit  training. 
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3.  Develop  a Job-related  reading  program  for  duty  station  personnel, 
consisting  of  reading  training  nriterials  in  the  three  career  cluster  areas. 

4.  Systems  engineer  selected  A schools  and  integrate  the  ASPT  into  the 
regular  training  day. 

5.  Systems  engineer  KT  and  integrate  the  JART  into  the  regular  training 

day. 

6.  Systems  engineer  the  rate  training  correspondence  courses  and  in- 
corporate job  reading  training  into  them. 

Example  of  an  A School  i’reparatory  Training  (ASPT)  Program 

The  first  product  required  in  the  R&D  program  is  a fixed-duration,  front- 
loaded,  job-related  reading  program  to  prepare  personnel  for  the  reading 
tasks  to  be  encountered  in  A school.  The  Army's  Advanced  Individual  Training 
Preparatory  Training  (a  job-related  reading  program)  is  the  model  for  the 
discussion  in  this  section  (Sticht,  1975a). 

The  ASPT  student  population  is  assumed  to  be  reading  below  the  7.0  grade 
level  as  measured  by  a standardized  reading  test  or  by  a Navy  job  reading 
test  scaled  to  produce  grade  level  scores.  This  level  is  based  on  Figure  3, 
which  showed  that  70  percent  of  the  NRTT  items  were  answered  correctly  by 
more  than  50  percent  of  the  people  reading  at  the  7th  grade  level.  Also, 
research  on  reading  denuinds  suggests  that  grade  7.0  is  a reasonable  minimum 
target  objective  for  reading  training  (Sticht,  1975a).  It  is  further  assumed 
that  the  lower  reading  level  for  students  in  ASPT  will  be  around  the  grade 
4.0  level.  Presumably,  people  below  this  level  will  have  been  brought  to  the 
4.0  level  in  the  Academic  Remedial  Training  given  during  RT. 

jl’he  duration  of  the  front-loaded  ASPT  program  is  assumed  to  be  6 weeks. 
Occasionally,  the  assignment  of  a more  skilled  reader  to  the  program  will 
require  that  he  be  moved  to  A school.  Other  problems  involved  in  early 
graduation  include  waiting  for  orders,  waiting  ror  an  A school  opening,  and 
maintaining  the  morale  of  those  who  have  grad\iated  and  those  who  must  continue 
their  training. 

Instructional  Curriculum 


The  instructional  curriculum  of  the  ASPT  consists  of  three  strands: 

Read ing-to-do , Read ing-to- 1 earn , and  Decoding. 

Strand  I — Reading-t  o-do.  This  strand  is  illustrated  in  Figure  6. 

Essential 'y,  it  employs  an  instructional  curriculum  foriruit  with  learning 
modules  based  on  the  types  of  information  sought  (fact-finding  and  following 
directions)  and  the  types  of  information  sources  or  displays  (text,  figures, 
etc.).  Each  module  is  accompanied  by  a pro-  and  post-proficiency  test  (PT) , 
which  determine  eligibility  for  t lu'  module  training  and  mastery  of  the  imuiule. 

Data  obtained  with  tiiese  PTs  jirovide  formative  data  for  module  development  and 
criterion  referenced  achievement  data  for  students.  The  pro-  and  post -sumnvii  t i ve 
reading  test  siiown  in  F'lgure  6 would  hi>  a Navy  Reading  Task  Test  scaled  for  read- 
ing grade  Iev»-1  or  norme<!  in  juMcentiles  (If  reading  graiie  level  scores  are  not 
desired).  The  former  permit  the  use  of  the  norms  establisheii  fi>r  the  standardized 
test  used  in  scaling  the  NRi'T  ;ind  they  articulate  the  Navy  res\ilts  with  otiier 
programs  that  use  reading  grade  levels. 
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The  module  materials  should  reflect  the  fact  that  Strand  1 is 
primarily  intended  to  provide  extensive  drill  and  practice  in  performing 
Navy  reading  tasks.  Thus,  each  module  would  consist  of  source  materials 
and  numerous  worksheets  that  require  that  the  person  perform  the  tasks 
indicated  by  the  module  name.  The  worksheets  should  be  designed  to  emphasize 
three  dimensions:  structure,  content,  and  difficulty. 

A structural  worksheet  should  cause  the  person  to  notice  how  an  in- 
formation source  or  display  is  put  together  (e.g.,  a table  imiy  have  rows, 
columns,  headings,  etc.).  Specific  questions  should  be  developed  to  require 
the  processing  of  information  about  structural  features. 

A content  workslieet  should  cause  the  person  to  attend  to  the  content 
of  an  information  display  (e.g.,  a fact-finding  worksheet  might  ask  for  a 
person  to  locate  a specific  fact  in  a given  display). 

A difficulty  dimension  should  be  Incorporated  into  both  structural 
and  content  worksheets.  r.ssentially,  the  idea  is  to  start  witli  easy  questions 
and  gradually  make  ttiem  more  difficult  in  terms  of  the  amount  of  information 
to  be  presented  in  the  amount  of  paraphrasing  (which  places  a stress  on  the 
students'  vocabulary),  or  other  techniques  as  appropriate. 

The  kit  of  more  t(ian  300  ;job  reading  tasks  developed  during  this 
effort  (see  Footnote  1,  page  12)  provides  a resource  for  the  initial  develop- 
ment of  Strand  I materials.  This  kit  Includes  the  actual  irviterlals  Navy  per- 
sonnel reported  reading  on  the  jobs  in  Class  A schools,  and  can  serve  as  the 
information  sources  for  the  instructional  modules.  Each  reading  task  state- 
ment in  the  kit  includes  statements  on  an  information  need  the  person  had  when 
the  materials  were  read,  wliich  illustrate  the  types  of  questions  that  can  be 
included  in  the  module  worksheets. 

Strand  II — Read ing-to- learn.  This  strand  contrasts  with  the  Strand  I 
activities  in  that  it  is  oriented  toward  urocessing  information  for  future 
use,  and  hence  emphasizes  the  development  of  skill  in  manipulating  written 
information  to  increase  its  storage  in  and  retrieval  from  memory.  To  process 
information  for  learning,  a person  must  have  the  knowledge  base  that  can  be 
brougjit  to  beat  in  comprehending  the  material  to  he  learned,  and  he  must  bo 
knowl edgab 1 e of  and  be  able  t o- ski  1 1 f ul ly  perform  the  following  intentional 
learning  strategies  identified  by  Sticlit  et  al.  (1977):  reread/rehearse, 

problem  solve/question,  relate/assoc  late,  and  focus  attention. 

To  promote  the  acquisition  of  a relevant  knowledg.e  base  that  will 
help  learn  better  from  their  A school  written  m/iterials,  mucli  of  wliicli  will 
be  written  at  readability  levels  of  11th  to  12th  grade  (Dulfv,  I'l7b), 

Strand  II  includes  iruiterials  tliat  are  written  at  a lower  difficulty  level 
and  titat  incorporate  the  basic  concepts  within  a career  cluster. 

To  identify  the  basic  topics  to  be  discussed  in  Strand  II,  candidate 
lists  from  A school  curriculum  guides  can  be  developed  and  contcMU  ex]ierts  at 
the  A schools  and  on  the  job  can  b<>  consulted.  

Th«'  content  rmiterials  can  be  300  to  lOOn  words  in  li'iigth  with  a high 
density  of  concepts.  I'lu'  redundancv  and  i-laboration  usua  i 1 v needed  to  explicate 
concepts  in  writtisi  materials  are  not  needed  in  Strand  IT  because  the  student 
will  perform  repeated  ri’ading.s  and  conduct  various  elaborations  in  storing,  and 
retrieving  i n format  ion. 


Figure  7 presents  a fictitious  set  of  content  topics  that  miglit  be 
developed  for  the  Data  Group  career  cluster.  (The  content  areas  are  actu- 
ally taken  from  the  content  area  matrices  developed  by  Huff  et  al.  (1976) 
for  the  Air  Force's  job-oriented  reading  program  for  duty  station  person- 
nel.) The  figure  also  shows  tiie  information  processing  activities  as 
column  headings.  Cell  entries  suggest  different  types  of  specific  activities 
that  might  be  required  for  each  content  area  and  information  processing 
activity  read ing-to-learn  task. 

Strand  11  activities  would  be  taugiit  in  the  classroom,  witii  students 
working  in  teams  or  small  groups,  and  with  teaclier  demonstration  and  feed- 
back. This  approacii  permits  students  to  take  a break  from  the  solo  drill 
and  practice  of  Strand  I and  to  engage  in  social  activity.  This  is  necessary 
under  a front-loaded,  full-day-of-study  type  of  program  to  prevent  boredom 
and  fatigue. 

Because  Strand  II  materials  are  teacher-guided,  a thorough  teacher's 
manual  must  be  developed.  Such  a manual  should  include  the  rationale  for  the 
ASPT  program  and  a summary  of  the  general  research  in  information  processing 
which  the  Strand  II  activities  reflect.  Much  of  this  research  is  summarized 
in  Dansereau,  Long,  and  McDonald  (1975);  Frase  (1975);  and  Sticht  (1975a). 
Hayes  (1976)  also  suggests  topics  to  be  discussed  in  this  regard. 

Evaluation  of  Strand  II  activities  is  less  systematic  in  the  formative 
area  than  Strand  I.  In  Strand  II,  student  classroom  products  are  evaluated 
by  the  teacher  and  by  other  students  in  group  discussion.  In  addition  to  pro- 
viding the  teacher  with  opportunities  for  evaluation,  tliese  discussions  also 
present  the  information  in  tiie  written  passages  in  a spoken  form  and  can  be 
used  for  defining  unfamiliar  words  and  elaborating  on  unfamiliar  concepts. 
These  discussions  should  also  be  used  to  introduce  new  content  areas.  Tlie 
oracy  to  literary  sequence  is  discussed  elsewhere  (cf,  Sticlit,  Beck,  llauke, 
Kleiman,  & James,  1974). 

Informal  evaluations  can  be  supplemented  by  pre-  and  post-summat ive 
tests  developed  for  eacli  of  the  four  categories  of  information  processing. 
Sticht  (1976)  presents  examples  of  two  tests  of  relate/assoc iate  activities: 
skill  in  making  classification  tables  and  flow  charts  using  content  ari>a 
passages.  Additional  tests  can  be  developed  for  t lie  remaining  intiirmation 
processing  activities. 

Additionally,  pre-  and  post-test  summative  measures  of  t lu>  acquisition 
of  knowledge  included  in  the  content  area  passages  should  hi'  constructed  to 
measure  the  student's  development  of  a knowledge  base  for  learning  by  reading 
in  A si'hools. 

Strand  111  — Decoding.  This  component  of  t lie  ASTT  program  is  meant 
to  provide  students  with  knowledge’  useful  for  translorming  printed  words  into 
spoken  words  and  sentences  into  semantic  representations.  Add i t i ona I I v , the 
decoding  strand  proviiles  pr.actice  to  di’velop  skill  in  efficientlv  translorming 
connected  prose  into  mc’aning. 
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CONTENT  AREAS 

REREAD/ 

REHEARSE 

PROBLEM  SOLVE/ 
QUESTION 

RELATE/ 

ASSOCIATE 

FOCUS  j 

ATTENTION  ! 

Career  Field 
Progression 

(Skills  upgrad- 
ing process, 
skill  levels, 
career  field 
general  struc- 
ture) 

Efficiency 
of  Reading 

Answering 
questions 
about  who, 
what,  where, 
when,  why. 

Classif Ica- 
tion  matrix 
construct  ion . 

Underlining  | 

Communicat ions 
Security 

(Security  clas- 
slf icat ions , 
methods  of 
transmission, 
accountability 
of  classified 
information) 


Preview/ 

Review 

Techniques 


Writing 

questions. 


Drawing 

illustra- 

tions. 


OuLllning 


Supply 

Requisitions 
(Supplies  and 
equipment  cus- 
todial accounts, 
submission  pro- 
cedures, con- 
trolling doc- 
uments & forms) 


Skimming 


Solving  vo- 
cabulary 
test 

problems . 


Construct- 
ing flow 
charts . 


Summarizing 


Publ ications 
Management 
(System,  up- 
dating proce- 
dures, files) 


Scanning 


Test  taking 
practice. 


Para- 

phrasing. 


Notetaking 


Figure  7.  Illustration  of  a partial  matrix  for  Strand  II:  Reading-to- 

learn  content  passages  and  information  processing  activities 
to  be  performed  on  the  content  passages  for  the  Navy's  Data 
Group  career  cluster. 
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The  knowledge  iisefuL  for  iransforming  printed  words  into  spoken  words 
is  that  generally  known  as  pliuaics  or  sight-sound  correspondences.  While 
people  wiio  develop  reading  skills  in  i "normal"  manner  over  tlie  school  years 
may  not  be  conscious  of  these  correspondences  and  may  not  require  explicit 
instructions  in  such  knowledge,  poorer  readers  may  find  this  information  of 
great  value.  Although  tlie  number  of  sight-sound  correspondence  rules  is  so 
great  that  teaching  all  of  them  is  out  of  the  question,  explicit  instruction 
in  a few  general  rules  can  be  of  heuristic  value  to  the  poorer  reader. 

At  a more  complex  level  of  analysis,  knowledge  for  decoding  sentences 
can  also  be  a useful  tool  for  poorer  readers.  The  Army's  functional  literacy 
program  contains  a simplified  approach  to  the  decoding  of  sentences  that 
divides  all  sentences  into  two  basic  parts:  (1)  the  main  idea,  and  (2)  more 

about  the  main  idea  (Sticht,  1975a).  In  turn,  the  main  idea  is  broken  into 
subject  and  action  wliile  tlie  "more  about"  component  is  discussed  in  terms  of 
who,  what,  when,  where,  etc.  This  type  of  knowledge  may  be  of  most  value 
where  complex  texts  must  be  analyzed. 

The  third  part  of  the  decoding  strand  simply  provides  practice  in 
reading  to  develop  the  same  capacity  for  storing  information  presented  in 
the  printed  form  that  one  has  for  processing  spoken  language.  For  this 
purpose,  textual  materials  should  be  used  that  present  narratives  such  as 
Navy  history  or  the  content  passages  of  Strand  li. 

Recently,  an  experimental  test  for  assessing  d iscrepancies  in  oral 
and  written  language  capacities  was  developed  for  the  Air  Force  (Sticht  iS 
Beck,  1976).  This  test  might  be  examined  for  ideas  about  assessing  tlie 
development  of  automat icity  in  reading  which,  in  the  case  of  the  Air  Force 
test,  is  considered  to  be  achieved  when  one  uses  printed  language  as  accurately 
and  efficient  1;.  as  one  uses  the  spoken  language. 

Implcmentat ion 

The  developmental  effort  should  involve  an  experimental  school 
where  tryout  of  techniques,  materials,  and  procedures,  both  for  leaching 
students  and  training  instructors,  can  take  place.  The  current  ART  may 
serve  as  an  initial  tryout  school  but,  as  soon  as  a rough-bu t -ready 
curriculum  can  be  developed,  an  operational,  experimental  ASl’T  should 
be  established.  To  gain  credibility  f'tr  subse()uent  dissemination  and 
implementation,  it  is  essential  that  the  development  and  implementation 
team  have  extensive  experimice  in  operating  an  oper.itional  school,  <md 
in  dealing  with  the  various  administrative  and  instructional  "crises"  that 
"operational"  (leople  experience.  This  experience  makes  possible  the  develop- 
ment of  gre.'iter  rapport  for  the  dissemination  of  the  ASPT  program. 

An  Integrated  .lob  Sk  i 1 1 s/ Read  i ng  Skills  I'raining  Program 

The  develo[)ment  of  the  1 ron t- 1 oad I'd  ASPT  program  permits  ,i  total  concen- 
trat  ion  on  the  development  of  an  effective  job-iir  lent  ed  reading  tr.tining  pro- 
gram. However,  once  cons ider.ib Le  experience  with  such  a program  has  been 
achieved,  the  next  step  is  to  develop  an  integrated  job  skills  and  nsiding 
skills  program  in  which  (he  training  day  contains  both  t vpes  of  training. 
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mentioned  earlier,  the  change  from  the  front-loaded  to  integrated  reading 
training  is  evolutionary,  occurring  as  part  of  the  regular  upgrade  of  the  job 
skills  training  programs. 

To  accomplish  the  integration  of  job  skills  and  reading  skills  training, 
the  training  program  development  guidelines  must  require  that  new  programs  or 
program  revisions  eliminate  "nice-to-know"  information  to  reduce  total  training 
time.  Thus,  extra  time  spent  in  reading  training  would  produce  little  or  no 
increase  in  the  total  man-days  spent  in  the  resident  training  program.  The 
object  is  to  overcome  the  costs  of  a front-loaded  program,  which  adds  on  to 
the  time  spent  in  the  resident  training  pipeline  while  reducing  the  learning 
requirement  of  the  job  skills  training  by  focusing  only  on  job-relevant,  "need- 
to-know"  information. 

There  is  a precedent  for  the  teaching  of  reading  skills  in  the  course 
of  the  training  day:  The  Department  of  the  Army's  Marginal  Man  and  Military 

Service  (1965)  describes  research  projects  by  the  Army  and  Air  Force  to 
teach  academic  skills  during  basic  military  training.  However,  the  reading 
was  not  job-related,  nor  was  the  basic  military  training  program  developed 
to  be  self-paced  and  performance  oriented.  Rather,  the  traditional  class- 
room/lecture, lock-step  procedures  were  in  effect. 

Only  one  case  has  been  found  in  which  the  job  skills  training  was  first 
transformed  from  the  traditional  classroom  to  a self-paced,  performance 
(rather  than  paper-and-pencil  test)  oriented  program,  and  then  job-oriented 
reading  training  was  introduced.  Hungerland  and  Taylor  (1975)  describe  the 
effects  of  introducing  self-paced  instruction  into  the  Army's  Supplyman  course. 
They  found  that,  in  the  lock-step  course,  students  were  held  in  the  program 
for  35  training  days  while  the  average  time  in  the  self-paced  course  was  25 
days,  with  a range  from  13  to  44  days.  Only  7 percent  of  the  self-paced 
trainees  required  additional  time  to  complete  course  requirements.  All 
graduates  of  the  self-paced  course  met  the  same  end-of-course  test  criterion 
used  in  the  regular,  lock-step  course. 

To  incorporate  reading  training  into  the  Suppiyman  course,  the  Clerical 
career  cluster  was  modified  from  the  AITPT  program  to  focus  exclusively 
on  the  Supplyman's  materials.  Reading  training  was  provided  for  2 hours 
per  day  for  students  entering  the  Supplyman  course  and  who  read  below 
the  8th  grade  level  as  determined  by  the  standardized  reading  tests  and 
the  special  job-related  reading  tests  used  for  summative  evaluation  of  the 
AITPT  program. 

Integration  of  job  reading  training  with  the  self-paced,  modular  job  skills 
training  system  was  accomplished  by  directing  students  from  their  self-paced 
study  in  a Supplyman's  module  to  the  daily  block  of  2 hours  of  job  reading 
instruction.  They  then  returned  to  their  job  skills  training--all  within  the 
normal  training  day. 

In  addition  to  focusing  the  job  reading  specifically  on  the  Supplyman's 
materials,  the  AITPT  Clerical  program  was  modified  by  strictly  pacing 
the  student's  reading  training  to  his  progress  in  the  Supplv  covirso. 
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This  was  done  to  accelerate  student  progress  through  all  the  job  reading 
modules,  regardless  of  mastery,  within  whatever  time  it  took,  the  student 
to  complete  the  job  skills  training  section  of  the  Advanced  Individual 
Training  course. 

Results  showed  that  performance  on  the  job  reading  task  test  (JRTT)  In- 
creased from  an  average  reading  grade  level  of  5.5  before  training  to  7.2 
after  training,  and  the  percentage  of  students  meeting  the  minimal  job  read- 
ing requirement  of  7th  grade  level  on  the  JRTT  Increased  from  16  percent 
before  training  to  53  percent  at  the  end  of  the  integrated  training  program. 
Additional  details  are  given  in  Sticht  (1975a). 

This  study  suggests  that  it  is  feasible  to  introduce  job  training  and  job 
reading  training  within  the  same  training  day  without  adding  to  the  overall 
training  time  of  traditional  classroom,  lock-step  rating  training  programs. 
Although  such  training  is  not  likely  to  be  sufficient  for  the  poorest 
readers  who  enter  the  Navy,  the  inclusion  of  reading  training  during  recruit 
training  before  the  student  gets  to  ASPT,  and  the  provision  of  reading 
training  at  the  duty  station  following  ASPT,  makes  possible  tlie  long  period 
of  training  needed  by  the  poorest  readers  to  utilize  the  printed  language 
more  adaptively  for  learning  and  task  performance. 

Job-Related  Reading  Training  for  Duty  Station  Personnel 

The  major  difference  between  school  and  duty  station  personnel  is  that 
the  former  are  in  a residence  training  program  with  a daily  set  of  activities 
involving  learning  and  extensive  processing  of  information,  which  involves 
considerable  reading,  while  duty  station  personnel  are  in  an  operational 
mode  with  on-the-job  training  conducted  in  a casual  manner.  Tlie  pace  of  learji- 
ing  activities  is  much  slower  in  OJT,  where  only  25  percent  of  tlie  reading 
tasks  obtained  from  job  performers  are  read ing-to-learn  tasks.  Another  con- 
sideration is  that  duty  station  personnel  include  a wide  mix'-of  r.itings,  with 
perhaps  only  a few  in  each  rating  at  a given  duty  location.  Thus,  lew  or  no 
personnel  may  be  available  at  a given  time  to  participate  in  a job-oriented 
reading  program. 

The  manner  in  which  current  reading  instruction  is  delivered  for  duty 
station  personnel  reflects  the  fact  that  students  of  a wide  background  mav 
appear  on  a sporadic  basis  for  reading  instruction.  Thus,  idvantage  is  taken 
of  civilian  programs,  such  as  community  college  learning  centers,  and  of 
general  reading  classes  conducted  by  the  base  education  office. 

To  take  advantage  of  this  type  of  system  while  still  providing  job- 
oriented  reading,  the  Navy  must  develop  materials  tliat  are  largely  self- 
instructional  or  that  can  be  administered  by  a teacher  with  a minimum  of 
instruction.  Such  materials  could  be  distributed  to  local  reading  prc'grams 
or  be  used  in  a base  learning  center  or  education  office  as  nei’ded.  An 
example  of  a job-oriented  risid  ing  program  being  di-veloped  for  duty  station 
personnel  in  the  Air  I'orce  is  described  by  Huff  et  al.  (197(i);  the  use  ol  a 
learning  center  on  a drop-in  basis  lor  job-related  reading  training  in  the 
Army  is  discussi'd  by  Sticht  (l‘)75a). 
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Another  alternative  for  duty  station  personnel  is  the  development  of  rate 
training  correspondence  courses  tiiat  (1)  reflect  the  actual  demands  for  know- 
ledge on  the  job  and  (2)  use  exercises  calling  for  the  types  of  information 
processing  activities  taughi  in  the  job-oriented  reading  programs  for  recruit 
training,  A school,  and  dut>  station  personnel. 

Finally,  as  suggested  earlier,  the  counseling  system  must  be  modified  (1) 
to  bring  to  the  attention  of  personnel  the  need  for  and  availability  of  train- 
ing in  job  reading  skills,  and  (2)  to  assist  personnel  with  emotional  or  other 
personal  problems  that  interfere  with  career  development. 


DISCUSSION  AND  CONCLUSIONS 


Navy  Reading  Task  Inventory/Tesi  (NRTI/T) 

Although  the  NRTI  was  tested  on  only  four  personnel,  the  results  have 
provided  insights  for  future  research  in  this  area.  During  the  develop- 
ment and  testing  of  the  NRTI,  there  was  some  concern  as  to  whether  or  not 
personnel  would  be  able  to  disregard  the  material  content  of  the  generic 
display  when  determining  if  they  perform  job  reading  tasks  using  similar 
displays.  Analysis  of  tiie  responses  indicated  that,  indeed,  people  did 
not  completely  ignore  the  display's  content.  Kither  additional  research 
and  refinement  is  necessary  to  assist  personnel  in  better  understanding 
the  task  involved  in  the  NRTI,  or  the  approach  has  to  be  modified  to  remove 
the  content  distraction. 

There  was  also  a question  of  whether  or  not  the  three  examples  of  the 
generic  displays  in  tiie  NRTI  represent,  in  actuality,  different  levels  of 
complexity,  or  whether  the  personnel  were  responding  to  the  three  examples 
with  any  awareness  tiiat  the  displays  were  supposed  to  ht*  of  different 
complexity.  The  pilot  test  results  provided  no  evidence  to  indicate  that 
the  display  complexity  was  a factor  in  the  selection  process.  Furthermore, 
it  is  also  uncertain  tliat  this  dimension  of  complexity  was  tapped  in  the 
construction  of  the  NRTT,  so  as  to  contribute  to  the  difficulty  level  of  the 
NRTT  items.  It  may  be  that  the  difficulty  of  the  NRTT  is  a function  of  the 
questions  alone,  or  a combination  of  the  complexity  of  tlie  disp'ay  and  the 
statement  of  the  questions. 

Analysis  of  the  NRTT  data  also  indicated  that  some  of  Che  items,  par- 
ticularly the  Following  Directions  questions,  were  ambiguously  stated  so  as 
to  permit  a wide  range  of  correct  responses.  This  problem  can  he  rectified 
by  carefully  designed  multiple-choice  questions. 

Anotlier  concern  dealing  with  tlie  statement  of  the  Following  Directions 
items  is  how  close  an  approximation  these  questions  are  to  the  real-world 
situation.  This  artificial  creation  of  the  reading  task  may  be  imposing 
unrepresentative  information  processing  demands  that  are  not  involved  in 
the  real-life  execution  of  this  type  of  reading  task.  Additional  con- 
ceptualising of  the  information  processing  differences  between  the  I'act- 
Finding  and  Following  Directions  tasks  is  necessary,  along  with  more  study 
on  how  to  formulate  the  NRTT  questions  so  as  to  reflect  tlie  various  aspects 
of  tliese  two  skills. 

I’robably  tlie  most  difficult  question  to  answer  is  that  ol  the  validity 
of  the  NRTl/I'  as  a measure  of  the  reading  demands  of  Navy  ratings.  dob 
reading  demands  do  not  exist  In  and  of  themselves;  they  are  created.  The 
only  w.iy  to  determine  the  validity  of  an  instrument's  abililv  to  measure 
an  artificially  created  re(|u  i ri’ment  is  to  have  a model  or  theory  against 
which  to  compare  the  ri'sulls.  In  part  ot  this  research,  .i  model  was  di'veU'ped 
for  the  collection  ot  samples  of  job  reading  tasks.  Folli'wing  the  guidance 
provided  by  the  niculel,  the  dob  Reading  Task  Interview  was  constructed  and 
permitted  the  colli’ction  of  a large  number  of  job  reading  tasks.  However,  the 
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model  was  not  appropriate  to,  nor  useful  for,  developing  the  h'avy ' s Job 
Reading  Task  Tests.  What  was  needed  was  a "reading  test  model"  that  would 
include  tlieoretical  constructs  for  better  identification  and  understanding 
of  tlie  information  processing  demands  required  in  performing  reading  tasks 
so  tiiat  these  demands  might  be  reflected  in  the  construction  of  tlie  NKTT 
itself.  By  using  such  a model,  it  is  expected  that  tlie  reading  task  tests 
would  better  simulate  the  information  processing  done  in  actual  performance 
of  reading  tasks  in  a job  situation.  Also,  without  this  model,  it  is  dif- 
ficult to  know  if  people  are  making  a distinction  between  the  generic  dis- 
play and  its  content,  or  if,  in  fact,  there  are  any  differences  in  tlie 
manner  in  which  these  displays  are  used  with  the  two  generic  skills  of  Fact- 
Finding  or  Following  Directions.  As  mentioned  above,  the  problem  of  formulat- 
ing these  questions  needs  more  conceptual  development  and  exploration  so  as 
to  Vtermine  if  there  are  major  conceptual  differences  in  the  information 
processing  between  these  two  skills,  and,  if  so,  if  test  items  can  be  written 
to  evaluate  this  difference.  Given  these  methodological  considerations,  it 
is  not  clear  that  the  current  NRTl/T  actually  represents  our  own  conceptual 
distinctions,  or  even  if  these  are  useful  ways  of  thinking  about  job  reading 
tasks . 

What  has  been  accomplished  is  the  Initial  exploration  of  the  feasibility 
of  determining  job  reading  requirements  using  a methodology  which  both 
identifies  the  types  of  reading  tasks  performed  in  the  job  and  the  level  of 
general  reading  skill  required  to  perform  that  set  of  reading  tasks.  As  a 
result  of  this  exploratory  research,  three  Navy  Reading  Task  Tests  were 
developed  and  scaled,  a job  incumbent's  and  supervisor's  version  of  the  Navy- 
Reading  Task  Inventory  were  developed  and  pilot  tested,  and  a procedure  for 
combining  t'.e  data  from  the  N'KTl  and  the  NRTT  into  a single  statement  of  the 
reading  requirement  for  a specific  rating  was  developed.  In  addition,  the 
methodological  and  procedural  problems  encountered  in  tlie  researcli  and  develoji- 
ment  of  the  NRTI/T  were  discussed  and  recommendations  for  further  modification 
and  refinement  of  the  NRTI/T  liave  been  made.  (Jiven  tliese  experiences,  test 
results,  and  test  construction  limitations,  it  is  the  opinion  of  tlie  authors 
that  the  NRTI/T  approach  can,  with  additional  refinement,  be  used  effectively 
to  assess  the  reading  demands  of  Navy  ratings,  as  well  as  to  provide  informa- 
tion so  that  job-related  reading  curricula  and  objectives  can  be  more  meaning- 
fully conceived. 

Job  Skills  Training  and  GliD  .Systems 

Analysis  of  the  interview  data  and  inspection  of  the  Career  Development 
System  both  indicated  that  reading  could  act  as  a harrier  to  advancement  for 
a substantial  number  of  enlisted  personnel,  and  that  the  Navy  docs  not  have 
any  systematic  approach  to  literacy  training.  However,  the  effect  of  this 
barrier  is  unknown  and  neetls  to  be  assessed  through  future  researih.  Also, 
considerable  interaction  was  found  betwi-en  the  job  skills  training  and  career 
counseling  components,  but  again,  there  appeared  to  he  little  or  no  inter- 
action between  the  career  counseling  and  GKD  components  of  the  Career  Develop- 
ment System.  Thus,  it  appears  that  even  though  the  Navy's  Career  Development 
Systi'm  is  composed  of  three  major  subcomponents,  there  are  only  weak  or  limiti-d 
formal  and  informal  linkages  between  and  across  them.  In  I act,  the  GKD  sub- 
system seems  to  operate  almost  as  a separate  nonrelated  ent  itv.  However,  it 
does  seem  qtiite  possible  to  ulili/e  this  current  systi'm  in  the  development  ot 
the  inte>-,rited  job  sk  1 I 1 s/read  i ng  skills  training  system  with  on  I v minor 
mod  1 f i . at  i on  a . 
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Integrated  Job  Skills/Read  inK  Skills  Training  Pro>.’ram 


The  long  range  changes  for  developing  an  integrated  Job  Ski 1 Is/ Read i ng 
Skills  Career  Development  System  require  a sustained  program  of  Rf<D.  The 
general  approach  is  composed  of  two  basic  stages. 

Stage  1 requires  tlie  development  of  individual  job-related  reading 
programs  for  Class  A School  Training,  Recruit  Training,  and  permanent  dutv 
station  personnel.  In  this  stage,  the  A School  and  Recruit  Training  job- 
oriented  reading  programs  would  be  developed  as  front-loaded  (given  prior 
to  the  job  skills  training),  fixed  duration  (6  weeks  long)  programs  designed 
to  prepare  personnel  to  perform  the  reading  tasks  to  be  encountered  in  their 
skills  training  program.  The  suggested  developmental  sequence  involves  the 
initial  development  of  an  A School  Preparatory  Training  (ASPT)  program  for 
selected  ratings,  followed  by  revision  of  Recruit  Training's  current  Academic- 
Remedial  Training  program.  The  duty  station  personnel  program  would  be  the 
last  program  developed.  Since  it  is  not  a resident  course  and  the  program 
must  be  designed  to  accommodate  students  of  a wide  background  appearing  on 
a sporadic  basis  for  training,  this  calls  for  the  design  of  a job-related 
reading  program  of  a largely  self-instructional  nature,  wliicti  could  be 
administered  by  a regular  classroom  teacher  wltii  a minimum  of  instruction. 
This  Navy  developed  program  could  then  be  utilized  in  tlie  current  remedial 
reading  training  program  provided  under  the  PREP  program  or  as  part  of  the 
training  provided  in  a learning  center  environment. 

Throughout  this  phase  of  tlie  R&I)  activities,  it  is  necessary  tliat  an 
experimental  reading  school,  under  the  control  of  the  RND  staff,  be  avail- 
able to  provide  development  and  implementation  staff  members  operational 
experience  in  operating  a reading  school,  as  well  as  to  permit  the  tryout 
of  techniques,  materials,  and  procedures,  both  for  teaching  students  and 
training  instructors.  By  following  this  developmental  sequence,  it  permits 
the  complete  development  of  effective  job-oriented  reading  programs  prior 
to  initiation  of  Stage  2 activities. 

The  Stage  2 RM)  activities  are  concerned  witli  integration  ot  the  fully 
developed  A School  Preparatory  Training  and  Academic  Remedial  Training,  job- 
oriented  reading  programs  with  their  appropriate  job  skills  training  pro- 
grams. This  can  basically  be  accomplished  in  a two-fi'ld  ellort.  first, 
system  engineer  the  training  program  to  reduce  "nice-ti'-kiu'w"  inlormation 
and  to  permit  sell-pacing  ot  Instruction.  This  would  be  followed  bv  nu'dili- 
cation  of  the  abov(*  job  reading  [irogtrams  to  t it  into  the  engineered  job  skill 
prog, ram  through  carelul  articulation  of  the  sequence  and  scopi-  of  the  various 
skill  training  activities. 


The  development  ot  this  type  of  integrati-d,  sell-paced  training  both 
eliminates  the  costly  I r on  t - 1 oaded  , lixed  dur.ation  programs,  and  pi'inits 
the  taster  ma  t r i cul  a t i ini  of  brighti-r  students,  Llui.‘  ettect  ing,  not  onlv 
savings  in  training  cost,;,  hut  also  in  training,  time.  In  additiini,  job- 
related  training  enables  personnel  to  become  better  pertormeis  of  job  re.iding 
tasks . 

The  over. ill  goal  ot  the  itUegrated  Job  Sk  i 1 1 s/ Read  i ng.  .Skills  Traitting 
System  is  to  provide  ,i  siistaitied  jv-riod  ot  traitting,  avail.ible  to  .ill  li'vel'. 
ot  enlisted  personnel,  which  both  .id.-ipt  s the  training,  to  their  iiulividu.il 
learning,  needs  .ind  tr.iins  them  to  bei  ome  mori,'  .ul.iptive  le.irnet  .. 
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Cost  Effectiveness  of  Job-Related  Vs 


General  Reading;  Training; 


Few  empirical  data  exist  for  evaluating  the  cost-effectiveness  of  job- 
related  versus  general  reading  training.  In  developing  tlie  Array's  program, 
a -omparison  was  made  of  improvement  in  Job  reading  task  test  scores  for 
graduates  of  tiie  Job-related  reading  program  with  those  of  graduates  from 
the  Army  and  Air  Force  general  remedial  reading  training  programs  (Sticiit, 
1975a),  Results  indicated  that  the  job-related  reading  program  produced 
three  times  as  mucii  improvement  in  job  reading  task  performance  as  the  genera 
reading  program  did.  This  was  accomplished  in  less  time  than  tlie  Air  Force 
program  and  at  no  more  time  tiian  the  Army's  general  reading  program.  Because 
Array  manuals  and  materials  were  used  extensively,  material  costs  were  kept  at 
or  below  tliose  of  the  Army's  general  reading  program. 

Thus,  tiie  scant  data  available  suggest  that  the  Job-related  reading  pro- 
gram is  a more  cost-effective  program  for  producing  improvement  in  tlie  per- 
formance of  Job  reading  tasks.  Aside  from  this,  the  logic  of  reducing  train- 
ing time  and  making  reading  training  more  job  relevant  by  the  development  of 
an  integrated  job  skills  and  reading  skills  training  system  must  carry  the 
argument  for  a more  cost-effective  approach  to  reading  training. 


RK(’A)MMENI)ATI0NS 


A major  purpose  of  tlio  enriro  enterpriso  of  developing  an  integrated 
Job  skills/reading  skills  eareer  development  system  is  to  improve  t lie  job 
proficiency  of  personnel  VvJlille  reducing  the  costs  of  training.  To  do  this, 
it  is  recommended  that: 

1.  The  training  programs  be  systems  engineered  and  self-paced  to  reduce 
training  time. 

2.  Training  time  be  reduced  for  reading  programs  such  as  Academic 
Remedial  Training,  which  add  several  weeks  of  resident  training  to  person- 
nel training  time,  by  converting  general  reading  training  into  job-oriented 
reading  training,  and  then  integrating  the  Job  skills  and  reading  skills 
training . 

3.  The  effectiveness  of  reading  training  for  improvement  of  job  per- 
formance be  iinreased  by  converting  general  educational  development  programs, 
such  as  ART  and  education  office  offerings,  into  Job-related  reading  wiiich, 
while  emphasizing  the  development  of  the  same  kinds  of  information  processing 
skills  developed  (usually  inefficiently)  in  GEl)  programs,  also  teach  a Job 
content  knowledge  base  for  performing  Job-related  reading  tasks. 
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NAVY  READING  TASK  TESTS  ITEMS  AND  ANSWER  KEYS 
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Experimental  Navy  Readlna  Task  Test  (NRTT) 


1.  Instructions  to  students. 

2.  The  NRTT:  Forms  E;  M;  D, 


¥ 


NAVY  READING  TASK  TEST 
(Instructions  to  Students) 

You  are  here  today  to  find  out  how  well  you  can  do  some  typical  Navy 
job  reading  tasks.  You  will  use  your  Bluejackets'  Manual  to  answer  the 
kinds  of  questions  that  have  to  be  answered  when  performing  various  Navy 
jobs. 

Is  tliere  anyone  who  does  not  have  a copy  of  the  Bluejackets'  Manual 
with  him  at  this  time? 

On  the  half-sheet  of  paper  that  is  attached  to  your  test 

1.  PRINT  your  last  name,  first  name,  and  middle  initial. 

2.  On  the  second  line,  write  your  social  security  number. 

3.  On  the  third  line:  If  you  have  ever  been  in  the  Navy  before, 

write  "YES"  and  the  number  of  years  you  were  in  the  Navy.  If 
you  have  not  been  in  the  Navy  before,  write  "NO"  on  the  third 
line. 

4.  Circle  the  number  witich  indicates  the  higliesL  year  of  education 
that  you  have  completed. 

Three  forms  of  this  test  have  been  distributed,  each  with  a different, 
but  similar  set  of  questions.  Each  test  has  16  questions  in  it.  You  will 
earn  one  point  for  each  question  that  you  answer  correctly.  There  is  no 
penalty  for  a wTong  answer,  so  try  to  answer  all  the  questions.  Don't  get 
liung  up  on  a question  that  is  hard  for  you — skip  it,  go  on  to  the  next 
question,  and  come  back  to  the  iiard  question  when  you  have  finislied  tlie 
others . 

Please  look  at  yout  test. 

All  answers  for  tliese  questions  can  be  found  in  the  Bluejackets' 
Manual.  Notice  that  tlie  answers  for  questions  1,  2,  ind  3 are  found  by  using 
ONLY  tlie  Table  of  Contents,  and  the  answers  for  questions  4,  5,  and  6 are 
found  by  using  ONLY  the  Index  of  the  Bluejackets'  Manual.  For  questions  7 
through  16,  you  are  given  the  page  number  or  numbers  on  which  the  answer  can 
be  found  and  the  type  of  nuiterial  in  which  the  answer  is  found.  Notice 
that  you  will  be  using  five  different  types  of  material  to  answer  these 
questions — text,  which  is  just  straight  printing;  figures;  tables;  text 
and  fig.res  combined;  and  text  an<l  tables  combined. 

Write  your  answers  in  the  spaces  provided  on  the  test  sheet.  When 
answering  a question,  be  sure  to  j’.ive  a complete  answer  to  each  question. 

Some  ot  the  (luesl  ions  will  reipiire  answers  longer  than  just  a few  words.  Be 
sure  to  read  each  question  carefully,  so  you  know  exactly  what  the  question 
is  asking. 
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We  will  now  go  through  several  practice  questions  of  the  type  you 
will  find  on  the  test. 


PRACTICE  QUESTIONS 

OK,  does  everyone  understand  how  to  take  this  test?  Are  there  any 
questions?  If  you  have  a question  during  the  test,  raise  your  hand  and 
someone  will  come  by  to  help  you. 

You  will  have  45  minutes  to  complete  the  test.  If  you  finish  the  test 
early,  review  your  answers  and  then  sit  quietly  until  the  end  of  the  test 
session.  Are  you  ready?  Begin. 
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PRACTICE  QUESTIONS  *******  PR,\CTICE  QUESTIONS  *******  PRACTICE  OUESTIONS 

ANSWER  KEY 

Example  1 

Using  only  the  Table  of  Contents,  answer  the  following  questions. 

a.  Wliat  is  the  title  of  the  chapter  where  you  could  find  information  about 
different  types  of  ships? 

SHIP  TYPES 

b.  \>Hiat  is  the  page  number  where  you  would  look  to  find  information  about 
different  types  of  ships? 

202 

Example  2 

Using  only  the  Index,  give  the  page  number (s)  where  you  could  find  the 
following  item. 

Lower  Deck  Patrol  169 

Example  3 
Type  of 

Material  Page 

Text  457  Wliy  is  the  metal  nozzle  at  the  end  of  a fuel 

hose  grounded? 

TO  PRIA'ENT  SPARKS  FROM  STATIC  ELECTRICITY. 


Examp I e 4 

Tex  t & 

Figure 

Wliat  else  must  you  do  before  you  can  begin  to 
raise  liim  to  a standing  position? 


487  S it  iiat  ion : You  are  lifting  an  injured  patient 

by  using  tlie  "Fireman's  Lift."  You  have  lifteii 
tlie  patient  up  to  his  knees. 


SLIDE  YOUR  1L\NI)S  DOWN  LOWER  AND  CI.ASP  THEM  AROUND  HIS  BACK. 


ANSWKK  RKY 


NR'i'T  E 

April  1976 

Using  only  the  Table  ol  Contents,  answer  the  following  three  c|iiostions. 

1.  Wliat  is  the  title  of  tlie  chapter  wliere  you  could  find  first  aid  in- 
structions for  treating  a burn? KIRS  T A I D 

2.  Wliat  is  the  chapter  number  in  wliich  you  could  find  information  about 

firefighting? ^ 


3.  Wliat  is  tlie  page  number  where  you  would  look  to  find  information  about 
the  history  of  the  Navy?  597 


Using  only  the  Index,  give  the  page  number (s)  where  you  could  find  the 
following  items. 


4. 

VRB 

567 

5. 

Rigging  wire 

rope  (a)  347-355,  447 

(b) 

347  ,348,349, 

350,351 

,352,447 

(c)  347-447 

(d) 

347 

6. 

Precautions 

when  handling  ammunition 

(a) 

244,  435-436 

(b) 

2A4 

(c) 

435 

(d) 

4 36 

Location  of  Material 
To  Be  Used  In 
Bluejackets'  Manual 


Type  of 

Material  Page 

7.  Text  173  In  assigning  enlisted  details,  who  serve 

as  assistants  to  the  ship's  ntister-at-arms? 


(a)  DIVISION  POLICt;  PKTTY  OFFICER  (b)  DPPO 

8.  Fig  15-7  295  How  many  100-ft  hose  sections  are  included 

in  a standard  shipboard  fire  plug  installation 

(a)  2 (6)  200  feet 


9.  Table  2A5 


10.  Text  & Fig  381-383 


Wliat  is  the  weight  of  the  MU'  rifle? 
7-1/2  lbs 


Wlien  using  a spray  painting  gun,  liow  far 
from  surface  sliould  the  gun  he  lu'ld? 


6"  - in" 


11.  Text  6 Table  206 


Wliat  does  tlie  g.eneral  ship  e lass  i f i ca  t ion 
for  a seaplane  tendet  mean? 


AUXILIARY 
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Mat  i*r  tal 


1^.  Text  476  Situation:  You  are  treating  an  unconscious 

person  for  heatstroke.  You  have  moved  the  person 
to  a cool  place  and  removed  his  clothing. 

What  else  should  you  do  before  you  spray  his  body 
with  cold  water? 

PLACE  ON  BACK  WITH  HEAD  AND  SHOULDERS  RAISED. 


13.  Fig  15-8  296  Situation:  You  are  fighting  a fire  using  an  all- 

purpose hose  nozzle  in  the  high  velocity  fog 
position.  You  have  just  received  orders  to  use 
low  velocity  fog  on  the  fire.  After  you  have 
turned  off  the  water  by  moving  the  lever  to  the 
"SHirr"  position, 

What  two  things  must  be  done  to  get  low  velocity 
fog? 

ATTACH  4-FOOT  APPLICATOR  (FOG  HEAD)  AND  MOVE  HANDLE  TO  FOG  POSITION. 


14.  Table  72  Situation:  You  have  been  given  instructions  to 

check  all  clothes  to  make  sure  they  are  marked  in 
the  right  way.  When  checking,  you  find  out  that 
your  raincoat  has  not  been  marked. 

Where  should  your  raincoat  be  marked? 

INSIDE  ON  LINING.  THREE  INCHES  BELOW  COLLAR  SEAM. 


15.  Text  & 381-383  Situation:  You  were  asked  to  paint  a small  building 

Figures  using  a spray-painting  gun.  You  have  painted  the 

entire  building  except  for  tlie  corners. 

How  should  tlu'  corners  be  painted? 

(a)  SPRAY  DIRECTLY  INTO  CORNER.  NOT  PAST  IT. 

(b)  SPRAY  UP  TO  WITHIN  2 INCHES  OF  CORNER.  TURN  GUN  SIDEW.4YS  & SPR,\Y  DOWNI^IARD. 

SPRAYING  BOTH  SIDES  AT  ONCE. 

(c)  CENTER  THE  GUN  DIRECTLY  INTO  THE  CORNER. 

(An  answer  with  any  or  all  of  tills  information  shall  be  scored  correct.) 

16.  Text  & 206-207  Situation:  You  are  on  watch  and  have  been  told  to 

Table  report  all  ships  that  you  see.  When  reporting,  you 

have  been  told  to  first  give  the  ship's  general 
classification  and  tlien  the  designation.  You  have 
sighted  a light  cargo  ship. 

What  do  you  report? 

(a)  LIGHT  CARGO  SHIP  AKL  (b)  AUXILIARY  - AKI.  tc)  AKl. 


ANSW'R  KEY 


NRTT  FORM  M 
April  1976 


UslriK  only  the  Table  of  Contents,  answer  the  following,  thrt^e  questions. 

1.  Wliat  is  the  t it le  of  the  chapter  where  you  could  find  first  aid  instruc- 
tions for  treating  a burn? 


2.  Wliat  is  the  chapter  number  in  which  you  could 
firefighting? 


FIRST  AID 

find  information  about 

15 


3.  Wliat  is  the  page  number  where  you  would  look  to  find  information  about 
the  history  of  the  Navy? 

597 


Using  only  the  Index,  give  the  page  number (s)  where  you  could  find  the 
following  items. 


4. 

VRB 

567 

5. 

Rigging  wire 

rope  (a)  347-355,  447 

(b) 

347,348,349,350,351,352,447 

(c)  347-447 

(d) 

347 

6. 

Precautions 

when  handling  ammunition 

(a) 

244,  435-436  (b)  244 

(c) 

435  (d)  436 

Location  of 

Material 

To  Be  Used 

In 

Bluejackets ' 

Manual 

Type  of 

Material 

Page 

7.  Text  365  In  target  detection,  what  docs  I EE  mean? 

lUENTIFICATION,  FRIEND  OR  FOE  


8.  Fig  20-2  J 409  How  many  white  navigational  liglits  are  required  tor 

a 200-ft  power  vessel  underway  under  internal imial 
rules? 

3 


9.  Tc'ible  412  Wliat  does  three  short  blasts  of  a whist  le  mean  in 

international  waters? 

MY  ENGINES  ARE  COINC  ASTERN. 


10.  Text  & 246-247  WluMi  stripping  a .45  caliber  pistol,  what  must  be 

Figure  removed  from  the  mu7,zle  end  ot  the  barrel? 

(a)  BARREE  liUSHlNt;.  (b)  RECOIL  Sl’RINC  Fl.UC  (c)  HARJUd  BUSH  INC  4 KlVOIl  SFKINC. 

ri.uc. 


11.  Text  4 341 

lab  1 e 


How  many  fathoms  of  chain  are  in  a 4 shi't  anclu'r  chain,' 
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451  Situat  ion:  You  liave  been  asked  to  go  aloft  to 

work  on  the  masts  and  stacks.  You  (lave  read 
your  work  assignment  and  are  about  ready  to  go 
alof  t . 

What  else  must  you  do  before  you  go  aloft? 
OBTAIN  PERMISSION  FROM  OOP. 


I'ype  of 
Mater i al 

12.  Text 


13.  Fig  16-25  355  Situation:  You  are  on  a delivery  ship  rigging  an 

all-wire  span  for  fueling  at  sea.  You  have  attached 
the  trolleys  and  the  free  trolly  to  the  wire  span. 

What  else  must  you  attach  to  the  wire  span? 

PELICAN  HOOK.  HOSE  CLAMPS.  RETRIEVING  WIRE.  OUTBOARn  SADDLE.  Fl'EI,  HOSE. 

(An  answer  with  any  or  all  of  this  information  is  scored  correct,  unless 
additional  information  is  included,  in  which  case  the  answer  is  scored  incorrect.) 

14.  Table  329  Situation:  You  are  in  charge  of  loading  personnel 

on  LCVPs.  The  four  crew  members  are  already  in  the 
boat.  If  you  load  the  boat  to  capacity  wltli  combat- 
equipped  troops. 

What  will  be  the  total  number  of  personnel  you  can 
put  in  the  boat? 

(a)  36  (b)  40  (36  + 4)  (c)  40 


15.  Text  & 315-316  Situation:  You  are  putting  a permanent  whip  on  a 

Fig  16-4  line.  You  have  finished  binding  and  are  working  on 

the  last  cross-seize. 

How  do  you  finish  wliipping  the  line? 

(An  answer  with  any  or  all  of  the  information  given  below  shall  be  scored 
correc  t . ) 

(a)  SHOVE  NEEDLE  THROFCH  MIDDLE  OF  SfRANf)  /\ND  Cl'T  TWINE. 

(b)  SHOVE  NEEDLE  THROUCH  MIDDLE  & Cl'T. 

(c)  THE  LAST  ONE  GOES  THROOC.H  TUF,  Mimil.C. 

Id)  PULL  GOOD  AND  TIGHT. 

IH.  Ti*xt  6 225-226  S i tuat ion:  You  are  responsible  for  classitylng 

lable  merchant  ships.  What  classification  would  you  give 

a ship  with  t lie  following  c bar  ac  t er  i s t i cs  : 

A 475-ft  passenger  ship  that  >arrie.s  300  passengers 
powereu  by  turbo  electric  drive  and  has  2 proj'ellers? 

;f  ’ 
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ANSWKR  KEY 


NRTT  FORM  D 
April  1976 


UslriK  only  the  Tabl>;  of  Contents,  answer  the  following  three  questions. 


1. 


What  is  the  t itle  of  the  chapter  where  you  could  find  first  aid  instruc- 
tions for  treating  a burn? 

riRSTAin 


2.  What  is  the  chapter  number  in  which  you  could  find  information  about 

firefighting?  > 

3.  What  is  the  page  number  where  you  would  look  to  find  information  about 
the  history  of  the  Wavv? 

597 


Using  only  the  index,  give  the  page  number(s)  where  you  could  find  the 
following  items. 


4 .  VRB 


567 


5. 


6. 


Rigging  wire  rope  (a)  347-355,  447 
(c)  347-447 


Precautions  wlien  handling  ammunition 


(b)  347. 348. 349. 350. 351. 352.4.^7 
(d)  347 

(a)  244.  435-436  (b)  244 

(c)  435  (d)  436 


Location  of  Material 
To  Be  Used  In 
Bluejackets'  Manual 

Type  of 

Mater  ial  I’age 

7.  Text  390  When  calculating  GMT,  liow  many  iiours  would  yon 

add  to  the  standard  time  il  yo>i  were  in  zone  +3.' 


3 HOURS 


8.  Pig  16-18  348  In  addition  to  the  boom  beel  swivel  fitting, 

what  else  is  attached  to  the  kingpost? 

(a)  SWIVEI.  I rn  iNG  EOR  lOPPING  LIFT. 

(b)  SWIVEL  KlTTlNt:  FOR  TOPPING  LIFT  & BOOM  STEP  BRACKET 

9.  fable*  4 1 n What  is  the  meaning  of  this  symbol,  *****,  wh.-n 

used  in  a fog  signal  table? 


RISC  IMG  A BELL  FOR  FIVE  SECONDS. 


Text  6 

41  1-414 

When  two  vessel 

Is  meet  end 

('ll,  how  do  they  pass’ 

F igure 

I’on  It) 

PORT 

Text  f. 

1 15 

1 ti  a single  .’4 

hour  peri  Oil 

1 , h('W  many  t L 'cs  ai  c 

Table 

8 bi'lls  struck' 

6 
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Material 


Page 

12.  Text  317 

(An  answer  with  any  or 
all  of  the  information 
given  below  shall  be 
scored  correct . ) 


Situat ion:  You  are  making  a long  splice.  You 

have  completed  the  first  operation  and  have  pairs 
of  strands  at  three  positions.  After  each  of 
these  strands  are  halved, 

What  is  done  with  the  four  halves  before  the  loose 
ends  are  trlnmied? 


(a)  TWO  ARE  TIED  AND  THE  REST  ARE  TUCKED  OVER  AND  UNDER  THE  STRANDS. 

(b)  TWO  ARE  TIED  TOGETHER  WITH  OVERHAND  KNOT,  TWO  ARE  TUCKED  OVER  AND 

UNDER  ONE  OF  THE  FULL  RIIMAINING  STRANDS. 

(c)  ALL  STRANDS  ARE  TUCKED . 


13.  Figure  348  Sit  nation : You  are  rigging  a single  swing  boom. 

You  have  completed  all  the  rigging  except  to  rig 
the  topping  lift  leadline. 

IThich  three  blocks  must  this  line  go  tlirough 
before  it  reaches  the  gypsy  head  of  the  winch? 

SNATCH  BLOCK.  DOUBLE  TOPPING  LIFT  BLOCK  AT  KINGPOST.  DOUBLE  TOPPING  LIFT 
BLOCK  AT  BOOMHFAD. 


14.  Table  416  Situation : You  are  in  charge  of  sounding  fog 

signals.  Your  ship  is  towing  another  power 
vessel  when  you  encounter  heavy  fog. 

What  signal  will  you  sound  and  how  often  will  you 
sound  it? 

(a)  o o ONE  MINUTE  APART.  (b)  A LONC  BLAST,  2 SHORT  BLASTS. 

1 MINUTE  APART.  (c)  A 4-6  SECOND  MAST  FOLLOWED  BY  TWO  ONE-SECOND 
BLASTS  AT  LEAST  ONCE  PER  MINUTE. 


15.  Text  6>  413-414  Situation:  Your  ship  meets  another  ship  to  star- 

Fig  20-4  board  and  wishes  to  pass. 

In  which  direction  is  the  passing  made  and  what 
message  is  sounded? 

STARBOARD  10  STARBOARD  (TO  RIGHT)  AND  TWO  SHORT  BLASTS. 


It).  Text  Ai  135  Situat  ion:  You  are  on  evening,  wat>  h.  You  are 

1 ab 1 e told  to  report  to  your  chief  at  4 hells  and  at 

8 bells. 

At  what  times  will  you  report.' 


fa)  h:0f)  f,  8:00 


(b)  1800  f,  2000 
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APPENDIX  B 


NAVDf  READING  TASK  TEST/ INVENTORY : 
RESULTS  OF  EXPLORATORY  STUDY 


No t e — Last-minute  changes  in  the  NRTT/i,  and  the  discovery  tliat  an  edition 
of  i'iie  Bluejackets’  Manual  different  from  tliat  used  in  the  present  studv 
was  being  used  by  Navy  personnel,  resulted  in  some  items  being  omitted 
from  ei  tiler  t lu'  NR'I'T  or  NR'l'l  studies. 
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NAVY  READING  TASK  TEST/ INVENTORY  - RESULTS  OF  EXPLORATORY  STUDY 
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NAVY  READING  TASK  TEST/ INVENTCRY  - RESULTS 


Type  of  Task: 
Question : 


Finding  Facts  in  Tables  (Form 
What  is  the  weight  of  the  ►tlB 


CF  EXPLORATORY  STUDY 
E , I tem  9) 


ri  fie? 


Test  Results;  Percentage  of  personnel  at  each  reading  grade  level 
who  got  the  correct  answer. 

READING  GRADE  LEVEL 


6 

7 

8 

9 

10 

11 

12 

13 

14 

TOTAL 

N 

10 

8 

7 

8 

11 

8 

7 

6 

17 

82 

% 

90 

100 

100 

100 

100 

88 

100 

100 

100 

98 

Inventory  Results:  Frequency  with  which  this  type  of  task  is  performed. 

I 2 3 4 5 

I to  3 I time  2 to  3 1 or  more  Not 

times  each  times  times  Daily  Used 

a year  month  a month  each  week_  

(omi tte^) 

X 
X 

X 


Electronics  Technician 
Electrician's  Mate 
Gunner's  Mate 
Boatswain's  Mate 


small  arms  TABll 


Mxlel 

C.vit>rf 

CopactY 

We  Qht 

B Mc'  1-  -5;ih 

T»pe  ol  AM'On 

Mji  n.irge 

ER/Ktive  Range 

PS'Oi  *.M9nAi 

AOcai 
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."W  Yds 

500  Yds 
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7 1/2  ‘M 
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pump 

748  Yds 

4a5Cvds 

MACHINEGON  M2 

50  m. 

•t'L.-d  *'*  ! 
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45  mch« 

semiautomatic/ 
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7400  yds 

2250  yds 

MACH  GUN  V^«C 

7 e?  'YYY'h 
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2?  ib5 
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automatic 

320C 
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^ ni 
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S A 

H/k 
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NAVY  READING  TASK  TEST/ INVENTORY 


RESULTS  OF  EXPLORATORY  STUDY 


Type  of  Task:  Finding  Facts  in  Texts  and  Figures  (Form  E,  Item  10) 

Question:  When  using  a spray  painting  gun,  how  far  from  the 

surface  should  the  gun  be  held^ 


Test  Results:  Percentage  of  personnel  at  each  reading  grade  level 

who  got  the  correct  answer. 


READING  GRADE  LEVEL 


6 

7 

8 

9 

10 

11  12 

13 

14 

TOTAL 

N 

10 

8 

7 

8 

11 

8 

7 

6 

17 

82 

% 

90 

88 

100 

100 

100 

100 

100 

100 

94 

96 

Inventory  Results:  Frequency  with  which  this  type  of  task  is  performed. 

12  3 4 5 

1 to  3 1 time  2 to  3 1 or  more  Not 

times  each  times  times  Daily  Used 
___ _ a year  month  a month  each  weex 
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